Image display system, storage medium having stored therein image display program, image display method, and display device

ABSTRACT

A display device having a display screen and a goggle apparatus to which the display device is attachable are included. In a first display mode, a first image including a content image that is a non-stereoscopic image, and a first user interface image is displayed on a display screen, and in a second display mode, a second image including a content image composed of a left-eye image and a right-eye image having parallax with each other, and a second user interface image corresponding to the first user interface image is displayed on the display screen. Then, in the second display mode, the second user interface image is displayed at a position different from a position on the display screen where the first user interface image is displayed in the first display mode.

CROSS REFERENCE TO RELATED APPLICATION

The disclosure of Japanese Patent Application No. 2019-033866, filed onFeb. 27, 2019 and the disclosure of Japanese Patent Application No.2019-33867, filed on Feb. 27, 2019, are incorporated herein byreference.

FIELD

The technology shown here relates to an image display system, a storagemedium having stored therein an image display program, an image displaymethod, and a display device that are capable of displaying astereoscopic image.

BACKGROUND AND SUMMARY

Conventionally, there is a three-dimensional image display device thatcauses a user to visually confirm two images having parallax with eachother with their left and right eyes, thereby displaying athree-dimensional image. For example, in the three-dimensional imagedisplay device, a smartphone is accommodated in a goggle apparatus thatthe user can wear, and the user looks into a stereoscopic imagedisplayed on a display screen of the smartphone through the goggleapparatus and thereby can view the stereoscopically displayed image.

The three-dimensional image display device, however, does not at alltake into account the presentation of a user interface image forreceiving a touch operation of the user when the stereoscopic image isdisplayed on the display screen. Thus, there is room for improvement inconvenience regarding a method for presenting a user interface image.

Therefore, it is an object of an exemplary embodiment to provide animage display system, a storage medium having stored therein an imagedisplay program, an image display method, and a display device that arecapable of improving convenience regarding the presentation of a userinterface image.

To achieve the above object, the exemplary embodiment can employ, forexample, the following configurations. It should be noted that it isunderstood that, to interpret the descriptions of the claims, the scopeof the claims should be interpreted only by the descriptions of theclaims. If there is a conflict between the descriptions of the claimsand the descriptions of the specification, the descriptions of theclaims take precedence.

In an exemplary configuration of an image display system according tothe exemplary embodiment, an image display system includes a displaydevice having a display screen configured to display an image, and agoggle apparatus to which the display device is attachable. The imagedisplay system includes a computer configured to: set the display deviceto a first display mode or a second display mode different from thefirst display mode; in the first display mode, display on the displayscreen a first image including a content image that is anon-stereoscopic image, and a first user interface image; and in thesecond display mode, display on the display screen a second imageincluding a content image composed of a left-eye image and a right-eyeimage having parallax with each other, and a second user interface imagecorresponding to the first user interface image. In the second displaymode, the second user interface image is displayed at a positiondifferent from a position on the display screen where the first userinterface image is displayed in the first display mode.

Based on the above, when a display mode is switched, a user interfaceimage is displayed at different positions. Thus, it is possible toimprove convenience regarding the presentation of a user interfaceimage.

Further, the computer is further configured to detect whether or not thedisplay device is in an attached state where the display device isattached to the goggle apparatus, or detect whether or not the displaydevice is in a halfway attached state where the display device is beingattached to the goggle apparatus. In this case, when the display deviceis set to the first display mode, the display device may be switched tothe second display mode based on the detection result.

Based on the above, based on an attached state where a display device isattached to a goggle apparatus or a halfway attached state where thedisplay device is being attached to the goggle apparatus, the displaymode is switched. Thus, it is possible to seamlessly switch the displaymode.

Further, the display device may include an illuminance sensor. In thiscase, the goggle apparatus may include a light-shielding member. Thelight-shielding member is configured to, when the display device is inthe attached state where the display device is attached to the goggleapparatus, or is in the halfway attached state where the display deviceis being attached to the goggle apparatus, block light from the displaydevice to the illuminance sensor. Based on a detection result of theilluminance sensor, it may be detected whether or not the display deviceis in the attached state where the display device is attached to thegoggle apparatus, or it may be detected whether or not the displaydevice is in the halfway attached state where the display device isbeing attached to the goggle apparatus.

Based on the above, based on a light blocking state of the displaydevice, it is possible to easily detect whether or not the displaydevice is in the attached state, or whether or not the display device isin the halfway attached state.

Further, the display device may include a touch panel on the displayscreen. In this case, the first user interface image displayed on thedisplay screen may enable an operation instruction corresponding to atouch operation on the touch panel. The second user interface imagedisplayed on the display screen may enable an operation instructioncorresponding to a touch operation on the touch panel in a state wherethe display device is attached to the goggle apparatus.

Based on the above, it is possible to improve convenience regarding thepresentation of a user interface image for receiving a touch operation.

Further, as the content image composed of the left-eye image and theright-eye image, an image corresponding to the content image displayedas the non-stereoscopic image may be displayed on the display screen.

Based on the above, it is possible to seamlessly switch a stereoscopicimage and a non-stereoscopic image for the same content image.

Further, in the second display mode, the content image displayed in thefirst display mode immediately before being set in the second displaymode may be displayed as a stereoscopic image composed of a left-eyeimage and a right-eye image on the display screen.

Based on the above, it is possible to seamlessly switch a stereoscopicimage and a non-stereoscopic image for the same content image.

Further, in the second display mode, the left-eye image may be displayedin a first area of the display screen, the right-eye image may bedisplayed in a second area of the display screen that is different fromthe first area, and the second user interface image may be displayed ina third area of the display screen that is different from the first areaand the second area.

Based on the above, it is possible to prevent a first area and a secondarea for displaying a stereoscopic image from being defaced by beingsubjected to a touch operation, and also prevent a finger for performinga touch operation on a second user interface image from entering thefield of view in the state where the stereoscopic image is viewed.

Further, a user interface image that has substantially the same functionas and has a different shape from the first user interface image may bedisplayed as the second user interface image.

Based on the above, it is possible to display a user interface imagehaving a shape suitable for an operation and the display of astereoscopic image.

Further, in the second display mode, by adjusting a shape of the seconduser interface image to match a shape of a third area of the displayscreen that is different from the first area of the display screen fordisplaying the left-eye image and the second area of the display screenfor displaying the right-eye image, the second user interface image maybe displayed in the third area.

Based on the above, it is possible to display a user interface imagehaving an appropriate shape.

Further, the third area may be set in an upper portion or a lowerportion of the display screen that is sandwiched between the first areaand the second area of the display screen.

Based on the above, it is possible to display a user interface imagethat does not hinder the display of a stereoscopic image.

Further, the third area may be set in a lower portion of the displayscreen that is sandwiched between the first area and the second area ofthe display screen.

Based on the above, it is possible to display a user interface imagethat does not hinder the display of a stereoscopic image and facilitatesan operation.

Further, the goggle apparatus may include an opening portion configuredto, when the display device is attached to the goggle apparatus, exposethe third area that is a part of the display screen at least to outside.

Based on the above, it is possible to perform a touch operation fortouching a user interface image in the state where a display device isattached to a goggle apparatus.

Further, the opening portion may be formed at a position correspondingto a nose of a user when the user wears the goggle apparatus.

Based on the above, it is possible to form an opening portion withoutimpairing a light blocking effect.

Further, in the first display mode, the first user interface image maybe displayed in a superimposed manner on a content image displayed onthe display screen.

Based on the above, it is possible to display a relatively large contentimage without being influenced by the display of a user interface image.

Further, in the second display mode, the second user interface image maybe displayed as a non-stereoscopic image on the display screen.

Based on the above, the operation of touching a user interface image isfacilitated.

Further, the display device may further include a display device sideconnection end configured to electrically connect to another apparatus.In this case, the goggle apparatus may include a goggle apparatus sideconnection end configured to electrically connect to the display deviceside connection end. In accordance with a connection between the displaydevice side connection end and the goggle apparatus side connection end,it may be detected whether or not the display device is in an attachedstate where the display device is attached to the goggle apparatus, orit may be detected whether or not the display device is in a halfwayattached state where the display device is being attached to the goggleapparatus.

Based on the above, it is possible to certainly detect that a displaydevice is attached to a goggle apparatus, or certainly detect that thedisplay device is in a halfway attached state where the display deviceis being attached to the goggle apparatus.

Further, the exemplary embodiment may be carried out in the forms of astorage medium having stored therein an image display program, an imagedisplay method, and a display device.

According to the exemplary embodiment, when a display mode is switched,a user interface image is displayed at different positions. Thus, it ispossible to improve convenience regarding the presentation of a userinterface image.

These and other objects, features, aspects and advantages of theexemplary embodiments will become more apparent from the followingdetailed description of the exemplary embodiments when taken inconjunction with the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram showing a non-limiting example of the state where aleft controller 3 and a right controller 4 are attached to a main bodyapparatus 2;

FIG. 2 is a diagram showing a non-limiting example of the state whereeach of the left controller 3 and the right controller 4 is detachedfrom the main body apparatus 2;

FIG. 3 is six orthogonal views showing a non-limiting example of themain body apparatus 2;

FIG. 4 is six orthogonal views showing a non-limiting example of theleft controller 3;

FIG. 5 is six orthogonal views showing a non-limiting example of theright controller 4;

FIG. 6 is a block diagram showing a non-limiting example of the internalconfiguration of the main body apparatus 2;

FIG. 7 is a block diagram showing non-limiting examples of the internalconfigurations of the main body apparatus 2 and the left controller 3and the right controller 4;

FIG. 8 is a perspective view showing a non-limiting example of theexternal appearance of a goggle apparatus 150;

FIG. 9 is a front view showing a non-limiting example of the state wherethe main body apparatus 2 is attached to the goggle apparatus 150;

FIG. 10 is a front view showing a non-limiting example of the state ofthe main body apparatus 2 attached to the goggle apparatus 150;

FIG. 11 is a diagram showing a non-limiting example of the shape of afront surface abutment portion 151 b that is in surface contact with apart of a front surface of the main body apparatus 2;

FIG. 12 is a diagram showing a non-limiting example of the internalstructure of the goggle apparatus 150;

FIG. 13 is a side view showing a non-limiting example of the state ofthe main body apparatus 2 attached to the goggle apparatus 150;

FIG. 14 is a diagram showing a non-limiting example of the state of auser viewing an image displayed by an image display system;

FIG. 15 is a diagram showing a non-limiting example of the state of theuser holding the image display system;

FIG. 16 is a diagram showing non-limiting examples of images displayedon the main body apparatus 2 in a stereoscopic display mode and anon-stereoscopic display mode;

FIG. 17 is a diagram showing a non-limiting example of a data area of aDRAM 85 of the main body apparatus 2; and

FIG. 18 is a flow chart showing a non-limiting example of gameprocessing executed by the game system 1.

DETAILED DESCRIPTION OF NON-LIMITING EXAMPLE EMBODIMENTS

An image display system according to an exemplary embodiment isdescribed below. An example of the image display system according to theexemplary embodiment includes a game system 1 (as a minimumconfiguration, a main body apparatus 2 included in the game system 1)and a goggle apparatus 150. An example of the game system 1 includes amain body apparatus (an information processing apparatus; whichfunctions as a game apparatus main body in the exemplary embodiment) 2,a left controller 3, and a right controller 4. Each of the leftcontroller 3 and the right controller 4 is attachable to and detachablefrom the main body apparatus 2. That is, the game system 1 can be usedas a unified apparatus obtained by attaching each of the left controller3 and the right controller 4 to the main body apparatus 2. Further, inthe game system 1, the main body apparatus 2, the left controller 3, andthe right controller 4 can also be used as separate bodies (see FIG. 2).Hereinafter, first, the hardware configuration of the game system 1according to the exemplary embodiment is described, and then, thecontrol of the game system 1 according to the exemplary embodiment isdescribed.

FIG. 1 is a diagram showing an example of the state where the leftcontroller 3 and the right controller 4 are attached to the main bodyapparatus 2. As shown in FIG. 1, each of the left controller 3 and theright controller 4 is attached to and unified with the main bodyapparatus 2. The main body apparatus 2 is an apparatus for performingvarious processes (e.g., game processing) in the game system 1. The mainbody apparatus 2 includes a display 12. Each of the left controller 3and the right controller 4 is an apparatus including operation sectionswith which a user provides inputs.

FIG. 2 is a diagram showing an example of the state where each of theleft controller 3 and the right controller 4 is detached from the mainbody apparatus 2. As shown in FIGS. 1 and 2, the left controller 3 andthe right controller 4 are attachable to and detachable from the mainbody apparatus 2. It should be noted that hereinafter, the leftcontroller 3 and the right controller 4 will occasionally be referred tocollectively as a “controller”.

FIG. 3 is six orthogonal views showing an example of the main bodyapparatus 2.

As shown in FIG. 3, the main body apparatus 2 includes an approximatelyplate-shaped housing 11. In the exemplary embodiment, a main surface (inother words, a surface on a front side, i.e., a surface on which thedisplay 12 is provided) of the housing 11 has a generally rectangularshape.

It should be noted that the shape and the size of the housing 11 areoptional. As an example, the housing 11 may be of a portable size.Further, the main body apparatus 2 alone or the unified apparatusobtained by attaching the left controller 3 and the right controller 4to the main body apparatus 2 may function as a mobile apparatus. Themain body apparatus 2 or the unified apparatus may function as ahandheld apparatus or a portable apparatus.

As shown in FIG. 3, the main body apparatus 2 includes the display 12,which is provided on the main surface of the housing 11. The display 12displays an image generated by the main body apparatus 2. In theexemplary embodiment, the display 12 is a liquid crystal display device(LCD). The display 12, however, may be a display device of any type.

Further, the main body apparatus 2 includes a touch panel 13 on a screenof the display 12. In the exemplary embodiment, the touch panel 13 is ofa type that allows a multi-touch input (e.g., a capacitive type). Thetouch panel 13, however, may be of any type.

For example, the touch panel 13 may be of a type that allows asingle-touch input (e.g., a resistive type).

The main body apparatus 2 includes speakers (i.e., speakers 88 shown inFIG. 6) within the housing 11. As shown in FIG. 3, speaker holes 11 aand 11 b are formed on the main surface of the housing 11. Then, soundsoutput from the speakers 88 are output through the speaker holes 11 aand 11 b.

Further, the main body apparatus 2 includes a left terminal 17, which isa terminal for the main body apparatus 2 to perform wired communicationwith the left controller 3, and a right terminal 21, which is a terminalfor the main body apparatus 2 to perform wired communication with theright controller 4.

As shown in FIG. 3, the main body apparatus 2 includes a slot 23. Theslot 23 is provided on an upper side surface of the housing 11. The slot23 is so shaped as to allow a predetermined type of storage medium to beattached to the slot 23. The predetermined type of storage medium is,for example, a dedicated storage medium (e.g., a dedicated memory card)for the game system 1 and an information processing apparatus of thesame type as the game system 1. The predetermined type of storage mediumis used to store, for example, data (e.g., saved data of an applicationor the like) used by the main body apparatus 2 and/or a program (e.g., aprogram for an application or the like) executed by the main bodyapparatus 2. Further, the main body apparatus 2 includes a power button28.

The main body apparatus 2 includes a lower terminal 27. The lowerterminal 27 is a terminal for the main body apparatus 2 to communicatewith a cradle. In the exemplary embodiment, the lower terminal 27 is aUSB connector (more specifically, a female connector). Further, when theunified apparatus or the main body apparatus 2 alone is mounted on thecradle, the game system 1 can display on a stationary monitor an imagegenerated by and output from the main body apparatus 2. Further, in theexemplary embodiment, the cradle has the function of charging theunified apparatus or the main body apparatus 2 alone mounted on thecradle. Further, the cradle has the function of a hub device(specifically, a USB hub).

The main body apparatus 2 includes an illuminance sensor 29. In theexemplary embodiment, the illuminance sensor 29 is provided in a lowerportion of the main surface of the housing 11 and detects theilluminance (brightness) of light incident on the main surface side ofthe housing 11. It should be noted that an image can be displayed bysetting the display 12 to an appropriate brightness in accordance withthe illuminance of the light detected by the illuminance sensor 29. Inthe exemplary embodiment, based on the detected illuminance, it isdetermined whether or not the main body apparatus 2 is attached to thegoggle apparatus 150 described below.

FIG. 4 is six orthogonal views showing an example of the left controller3. As shown in FIG. 4, the left controller 3 includes a housing 31. Inthe exemplary embodiment, the housing 31 has a vertically long shape,i.e., is shaped to be long in an up-down direction (i.e., a y-axisdirection shown in FIGS. 1 and 4). In the state where the leftcontroller 3 is detached from the main body apparatus 2, the leftcontroller 3 can also be held in the orientation in which the leftcontroller 3 is vertically long. The housing 31 has such a shape and asize that when held in the orientation in which the housing 31 isvertically long, the housing 31 can be held with one hand, particularlythe left hand. Further, the left controller 3 can also be held in theorientation in which the left controller 3 is horizontally long. Whenheld in the orientation in which the left controller 3 is horizontallylong, the left controller 3 may be held with both hands.

The left controller 3 includes an analog stick 32. As shown in FIG. 4,the analog stick 32 is provided on a main surface of the housing 31. Theanalog stick 32 can be used as a direction input section with which adirection can be input. The user tilts the analog stick 32 and therebycan input a direction corresponding to the direction of the tilt (andinput a magnitude corresponding to the angle of the tilt). It should benoted that the left controller 3 may include a directional pad, a slidestick that allows a slide input, or the like as the direction inputsection, instead of the analog stick. Further, in the exemplaryembodiment, it is possible to provide an input by pressing the analogstick 32.

The left controller 3 includes various operation buttons. The leftcontroller 3 includes four operation buttons 33 to 36 (specifically, aright direction button 33, a down direction button 34, an up directionbutton 35, and a left direction button 36) on the main surface of thehousing 31. Further, the left controller 3 includes a record button 37and a “−” (minus) button 47. The left controller 3 includes a firstL-button 38 and a ZL-button 39 in an upper left portion of a sidesurface of the housing 31. Further, the left controller 3 includes asecond L-button 43 and a second R-button 44, on the side surface of thehousing 31 on which the left controller 3 is attached to the main bodyapparatus 2. These operation buttons are used to give instructionsdepending on various programs (e.g., an OS program and an applicationprogram) executed by the main body apparatus 2.

Further, the left controller 3 includes a terminal 42 for the leftcontroller 3 to perform wired communication with the main body apparatus2.

FIG. 5 is six orthogonal views showing an example of the rightcontroller 4. As shown in FIG. 5, the right controller 4 includes ahousing 51. In the exemplary embodiment, the housing 51 has a verticallylong shape, i.e., is shaped to be long in the up-down direction.

In the state where the right controller 4 is detached from the main bodyapparatus 2, the right controller 4 can also be held in the orientationin which the right controller 4 is vertically long. The housing 51 hassuch a shape and a size that when held in the orientation in which thehousing 51 is vertically long, the housing 51 can be held with one hand,particularly the right hand. Further, the right controller 4 can also beheld in the orientation in which the right controller 4 is horizontallylong. When held in the orientation in which the right controller 4 ishorizontally long, the right controller 4 may be held with both hands.

Similarly to the left controller 3, the right controller 4 includes ananalog stick 52 as a direction input section. In the exemplaryembodiment, the analog stick 52 has the same configuration as that ofthe analog stick 32 of the left controller 3. Further, the rightcontroller 4 may include a directional pad, a slide stick that allows aslide input, or the like, instead of the analog stick. Further,similarly to the left controller 3, the right controller 4 includes fouroperation buttons 53 to 56 (specifically, an A-button 53, a B-button 54,an X-button 55, and a Y-button 56) on a main surface of the housing 51.Further, the right controller 4 includes a “+” (plus) button 57 and ahome button 58. Further, the right controller 4 includes a firstR-button 60 and a ZR-button 61 in an upper right portion of a sidesurface of the housing 51. Further, similarly to the left controller 3,the right controller 4 includes a second L-button 65 and a secondR-button 66.

Further, the right controller 4 includes a terminal 64 for the rightcontroller 4 to perform wired communication with the main body apparatus2.

FIG. 6 is a block diagram showing an example of the internalconfiguration of the main body apparatus 2. The main body apparatus 2includes components 81 to 91, 97, and 98 shown in FIG. 6 in addition tothe components shown in FIG. 3. Some of the components 81 to 91, 97, and98 may be mounted as electronic components on an electronic circuitboard and accommodated in the housing 11.

The main body apparatus 2 includes a processor 81. The processor 81 isan information processing section for executing various types ofinformation processing to be executed by the main body apparatus 2. Forexample, the processor 81 may be composed only of a CPU (CentralProcessing Unit), or may be composed of a SoC (System-on-a-chip) havinga plurality of functions such as a CPU function and a GPU (GraphicsProcessing Unit) function. The processor 81 executes an informationprocessing program (e.g., a game program) stored in a storage section(specifically, an internal storage medium such as a flash memory 84, anexternal storage medium attached to the slot 23, or the like), therebyperforming the various types of information processing.

The main body apparatus 2 includes a flash memory 84 and a DRAM (DynamicRandom Access Memory) 85 as examples of internal storage media builtinto the main body apparatus 2. The flash memory 84 and the DRAM 85 areconnected to the processor 81. The flash memory 84 is a memory mainlyused to store various data (or programs) to be saved in the main bodyapparatus 2. The DRAM 85 is a memory used to temporarily store variousdata used for information processing.

The main body apparatus 2 includes a slot interface (hereinafterabbreviated as “I/F”) 91. The slot I/F 91 is connected to the processor81. The slot I/F 91 is connected to the slot 23, and in accordance withan instruction from the processor 81, reads and writes data from and tothe predetermined type of storage medium (e.g., a dedicated memory card)attached to the slot 23.

The processor 81 appropriately reads and writes data from and to theflash memory 84, the DRAM 85, and each of the above storage media,thereby performing the above information processing.

The main body apparatus 2 includes a network communication section 82.The network communication section 82 is connected to the processor 81.The network communication section 82 communicates (specifically, throughwireless communication) with an external apparatus via a network. In theexemplary embodiment, as a first communication form, the networkcommunication section 82 connects to a wireless LAN and communicateswith an external apparatus, using a method compliant with the Wi-Fistandard. Further, as a second communication form, the networkcommunication section 82 wirelessly communicates with another main bodyapparatus 2 of the same type, using a predetermined communication method(e.g., communication based on a unique protocol or infrared lightcommunication). It should be noted that the wireless communication inthe above second communication form achieves the function of enablingso-called “local communication” in which the main body apparatus 2 canwirelessly communicate with another main body apparatus 2 placed in aclosed local network area, and the plurality of main body apparatuses 2directly communicate with each other to transmit and receive data.

The main body apparatus 2 includes a controller communication section83. The controller communication section 83 is connected to theprocessor 81. The controller communication section 83 wirelesslycommunicates with the left controller 3 and/or the right controller 4.The communication method between the main body apparatus 2 and the leftcontroller 3 and the right controller 4 is optional. In the exemplaryembodiment, the controller communication section 83 performscommunication compliant with the Bluetooth (registered trademark)standard with the left controller 3 and with the right controller 4.

The processor 81 is connected to the left terminal 17, the rightterminal 21, and the lower terminal 27. When performing wiredcommunication with the left controller 3, the processor 81 transmitsdata to the left controller 3 via the left terminal 17 and also receivesoperation data from the left controller 3 via the left terminal 17.Further, when performing wired communication with the right controller4, the processor 81 transmits data to the right controller 4 via theright terminal 21 and also receives operation data from the rightcontroller 4 via the right terminal 21. Further, when communicating withthe cradle, the processor 81 transmits data to the cradle via the lowerterminal 27. As described above, in the exemplary embodiment, the mainbody apparatus 2 can perform both wired communication and wirelesscommunication with each of the left controller 3 and the rightcontroller 4. Further, when the unified apparatus obtained by attachingthe left controller 3 and the right controller 4 to the main bodyapparatus 2 or the main body apparatus 2 alone is attached to thecradle, the main body apparatus 2 can output data (e.g., image data orsound data) to the stationary monitor or the like via the cradle.

Here, the main body apparatus 2 can communicate with a plurality of leftcontrollers 3 simultaneously (in other words, in parallel). Further, themain body apparatus 2 can communicate with a plurality of rightcontrollers 4 simultaneously (in other words, in parallel). Thus, aplurality of users can simultaneously provide inputs to the main bodyapparatus 2, each using a set of the left controller 3 and the rightcontroller 4. As an example, a first user can provide an input to themain body apparatus 2 using a first set of the left controller 3 and theright controller 4, and simultaneously, a second user can provide aninput to the main body apparatus 2 using a second set of the leftcontroller 3 and the right controller 4.

The main body apparatus 2 includes a touch panel controller 86, which isa circuit for controlling the touch panel 13. The touch panel controller86 is connected between the touch panel 13 and the processor 81. Basedon a signal from the touch panel 13, the touch panel controller 86generates, for example, data indicating the position where a touch inputis provided. Then, the touch panel controller 86 outputs the data to theprocessor 81.

Further, the display 12 is connected to the processor 81. The processor81 displays a generated image (e.g., an image generated by executing theabove information processing) and/or an externally acquired image on thedisplay 12.

The main body apparatus 2 includes a codec circuit 87 and speakers(specifically, a left speaker and a right speaker) 88. The codec circuit87 is connected to the speakers 88 and a sound input/output terminal 25and also connected to the processor 81. The codec circuit 87 is acircuit for controlling the input and output of sound data to and fromthe speakers 88 and the sound input/output terminal 25.

Further, the main body apparatus 2 includes an acceleration sensor 89.In the exemplary embodiment, the acceleration sensor 89 detects themagnitudes of accelerations along predetermined three axial (e.g., xyzaxes shown in FIG. 1) directions. It should be noted that theacceleration sensor 89 may detect an acceleration along one axialdirection or accelerations along two axial directions.

Further, the main body apparatus 2 includes an angular velocity sensor90. In the exemplary embodiment, the angular velocity sensor 90 detectsangular velocities about predetermined three axes (e.g., the xyz axesshown in FIG. 1). It should be noted that the angular velocity sensor 90may detect an angular velocity about one axis or angular velocitiesabout two axes.

The acceleration sensor 89 and the angular velocity sensor 90 areconnected to the processor 81, and the detection results of theacceleration sensor 89 and the angular velocity sensor 90 are output tothe processor 81. Based on the detection results of the accelerationsensor 89 and the angular velocity sensor 90, the processor 81 cancalculate information regarding the motion and/or the orientation of themain body apparatus 2.

The illuminance sensor 29 is connected to the processor 81, and thedetection result of the illuminance sensor 29 is output to the processor81. Based on the detection result of the illuminance sensor 29, theprocessor 81 can calculate information regarding the brightness of theperiphery of the main body apparatus 2.

The main body apparatus 2 includes a power control section 97 and abattery 98. The power control section 97 is connected to the battery 98and the processor 81. Further, although not shown in FIG. 6, the powercontrol section 97 is connected to components of the main body apparatus2 (specifically, components that receive power supplied from the battery98, the left terminal 17, and the right terminal 21). Based on a commandfrom the processor 81, the power control section 97 controls the supplyof power from the battery 98 to the above components.

Further, the battery 98 is connected to the lower terminal 27. When anexternal charging device (e.g., the cradle) is connected to the lowerterminal 27, and power is supplied to the main body apparatus 2 via thelower terminal 27, the battery 98 is charged with the supplied power.

FIG. 7 is a block diagram showing examples of the internalconfigurations of the main body apparatus 2, the left controller 3, andthe right controller 4. It should be noted that the details of theinternal configuration of the main body apparatus 2 are shown in FIG. 6and therefore are omitted in FIG. 7.

The left controller 3 includes a communication control section 101,which communicates with the main body apparatus 2. As shown in FIG. 7,the communication control section 101 is connected to componentsincluding the terminal 42. In the exemplary embodiment, thecommunication control section 101 can communicate with the main bodyapparatus 2 through both wired communication via the terminal 42 andwireless communication not via the terminal 42. The communicationcontrol section 101 controls the method for communication performed bythe left controller 3 with the main body apparatus 2. That is, when theleft controller 3 is attached to the main body apparatus 2, thecommunication control section 101 communicates with the main bodyapparatus 2 via the terminal 42. Further, when the left controller 3 isdetached from the main body apparatus 2, the communication controlsection 101 wirelessly communicates with the main body apparatus 2(specifically, the controller communication section 83). The wirelesscommunication between the communication control section 101 and thecontroller communication section 83 is performed in accordance with theBluetooth (registered trademark) standard, for example.

Further, the left controller 3 includes a memory 102 such as a flashmemory. The communication control section 101 includes, for example, amicrocomputer (or a microprocessor) and executes firmware stored in thememory 102, thereby performing various processes.

The left controller 3 includes buttons 103 (specifically, the buttons 33to 39, 43, 44, and 47). Further, the left controller 3 includes theanalog stick (“stick” in FIG. 7) 32. Each of the buttons 103 and theanalog stick 32 outputs information regarding an operation performed onitself to the communication control section 101 repeatedly atappropriate timing.

The communication control section 101 acquires information regarding aninput (specifically, information regarding an operation or the detectionresult of the sensor) from each of input sections (specifically, thebuttons 103, the analog stick 32, and the sensors 104 and 105). Thecommunication control section 101 transmits operation data including theacquired information (or information obtained by performingpredetermined processing on the acquired information) to the main bodyapparatus 2. It should be noted that the operation data is transmittedrepeatedly, once every predetermined time. It should be noted that theinterval at which the information regarding an input is transmitted fromeach of the input sections to the main body apparatus 2 may or may notbe the same.

The above operation data is transmitted to the main body apparatus 2,whereby the main body apparatus 2 can obtain inputs provided to the leftcontroller 3. That is, the main body apparatus 2 can determineoperations on the buttons 103 and the analog stick 32 based on theoperation data. Further, the main body apparatus 2 can calculateinformation regarding the motion and/or the orientation of the leftcontroller 3 based on the operation data (specifically, the detectionresults of the acceleration sensor 104 and the angular velocity sensor105).

The left controller 3 includes a power supply section 108. In theexemplary embodiment, the power supply section 108 includes a batteryand a power control circuit. Although not shown in FIG. 7, the powercontrol circuit is connected to the battery and also connected tocomponents of the left controller 3 (specifically, components thatreceive power supplied from the battery).

As shown in FIG. 7, the right controller 4 includes a communicationcontrol section 111, which communicates with the main body apparatus 2.Further, the right controller 4 includes a memory 112, which isconnected to the communication control section 111. The communicationcontrol section 111 is connected to components including the terminal64. The communication control section 111 and the memory 112 havefunctions similar to those of the communication control section 101 andthe memory 102, respectively, of the left controller 3. Thus, thecommunication control section 111 can communicate with the main bodyapparatus 2 through both wired communication via the terminal 64 andwireless communication not via the terminal 64 (specifically,communication compliant with the Bluetooth (registered trademark)standard). The communication control section 111 controls the method forcommunication performed by the right controller 4 with the main bodyapparatus 2.

The right controller 4 includes input sections similar to the inputsections of the left controller 3. Specifically, the right controller 4includes buttons 113 and the analog stick 52. These input sections havefunctions similar to those of the input sections of the left controller3 and operate similarly to the input sections of the left controller 3.

The right controller 4 includes a power supply section 118. The powersupply section 118 has a function similar to that of the power supplysection 108 of the left controller 3 and operates similarly to the powersupply section 108.

Next, with reference to FIGS. 8 to 15, a description is given of thegoggle apparatus 150, which is an example of an apparatus forming theimage display system by attaching the game system 1 (specifically, themain body apparatus 2) to the apparatus. It should be noted that FIG. 8is a perspective view showing an example of the external appearance ofthe goggle apparatus 150. FIG. 9 is a front view showing an example ofthe state where the main body apparatus 2 is attached to the goggleapparatus 150. FIG. 10 is a front view showing an example of the stateof the main body apparatus 2 attached to the goggle apparatus 150. FIG.11 is a diagram showing an example of the shape of a front surfaceabutment portion 151 b that is in surface contact with a part of a frontsurface of the main body apparatus 2. FIG. 12 is a diagram showing anexample of the internal structure of the goggle apparatus 150. FIG. 13is a side view showing an example of the state of the main bodyapparatus 2 attached to the goggle apparatus 150. FIG. 14 is a diagramshowing an example of the state of a user viewing an image displayed bythe image display system. FIG. 15 is a diagram showing an example of thestate of the user holding the image display system. It should be notedthat FIG. 11 is a diagram viewed from the same direction as in FIG. 10in the state (a transparent state) where a part of the goggle apparatus150 (a part of a main body 151, a lens frame member 152, a lens 153, anda plate-like member 154) is removed to show the front surface abutmentportion 151 b in an easily understandable manner.

In FIGS. 8 to 13, the goggle apparatus 150 includes a main body 151, alens frame member 152, a lens 153, and a plate-like member 154. Here,the goggle apparatus, which is an example of the apparatus included inthe image display system, is not limited to a configuration describedbelow so long as the goggle apparatus is worn fitted to the face of theuser by covering the left and right eyes of the user, and has thefunction of blocking at least a part of external light and the functionof supporting a stereoscopic view for the user with a pair of lenses.For example, the types of the goggle apparatus may include those used invarious states, such as a goggle apparatus that is fitted to the face ofthe user by the user holding the goggle apparatus, a goggle apparatusthat is fitted to the face of the user by fixing the goggle apparatus tothe head of the user, and a goggle apparatus into which the user looksin the state where the goggle apparatus is placed. Further, the goggleapparatus may function as a so-called head-mounted display by being wornon the head of the user in the state where the main body apparatus 2 isattached to the goggle apparatus, or may have a helmet-like shape aswell as the goggle-like shape. In the following description of thegoggle apparatus 150, a goggle-type goggle apparatus that is worn by theuser while fitted to the face of the user by the user holding the goggleapparatus is used.

The main body 151 includes an attachment portion to which the main bodyapparatus 2 is detachably fixed by the attachment portion being incontact with a front surface, a back surface, an upper surface, and alower surface of the main body apparatus 2. The attachment portionincludes a front surface abutment portion that is in surface contactwith a part of the front surface (the surface on which the display 12 isprovided) of the main body apparatus 2, a back surface abutment portionthat is in surface contact with the back surface of the main bodyapparatus 2, an upper surface abutment portion that is in surfacecontact with the upper surface of the main body apparatus 2, and a lowersurface abutment portion that is in surface contact with the lowersurface of the main body apparatus 2. The attachment portion is formedinto an angular tube which includes a gap formed by being surrounded bythe front surface abutment portion, the back surface abutment portion,the upper surface abutment portion, and the lower surface abutmentportion, and of which both left and right side surfaces are opened. Bothside surfaces of the attachment portion (a side surface further in apositive x-axis direction shown in FIG. 8, and a side surface further ina negative x-axis direction shown in FIG. 8) open so that the attachmentportion is attachable from the left side surface side or the right sidesurface side of the main body apparatus 2. Then, as shown in FIG. 9,when the main body apparatus 2 is attached to the goggle apparatus 150from the opening on the right side surface side of the main bodyapparatus 2, the front surface abutment portion is in contact with thefront surface of the main body apparatus 2, the back surface abutmentportion is in contact with the back surface of the main body apparatus2, the upper surface abutment portion is in contact with the uppersurface of the main body apparatus 2, and the lower surface abutmentportion is in contact with the lower surface of the main body apparatus2. It should be noted that as shown in FIG. 11, in a front surfaceabutment portion 151 b of the main body 151, an opening portion isformed so as not to hinder at least the field of view for display images(a left-eye image and a right-eye image) on the display 12 when the mainbody apparatus 2 is attached.

As shown in FIGS. 9 and 13, the main body apparatus 2 is attached to thegoggle apparatus 150 by inserting the main body apparatus 2 in a slidingmanner into the gap of the attachment portion of the main body 151 fromthe left side surface side or the right side surface side of the mainbody apparatus 2 along the front surface abutment portion, the backsurface abutment portion, the upper surface abutment portion, and thelower surface abutment portion of the attachment portion. Further, themain body apparatus 2 can be detached from the goggle apparatus 150 bysliding the main body apparatus 2 to the left or the right along thefront surface abutment portion, the back surface abutment portion, theupper surface abutment portion, and the lower surface abutment portionof the attachment portion from the state where the main body apparatus 2is attached to the goggle apparatus 150. As described above, the mainbody apparatus 2 can be detachably attached to the goggle apparatus 150.

The lens frame member 152 is fixedly provided on the opening portionside formed in a front surface portion of the main body 151. The lensframe member 152 includes a pair of lens frames opened so as not tohinder the field of view for display images (a left-eye image IML and aright-eye image IMR) displayed on the display 12 of the main bodyapparatus 2 attached to the main body 151. Further, on outer edgesformed in upper, lower, left, and right portions of the lens framemember 152, joint surfaces to be joined to the main body apparatus 2 areformed, and in a central portion of the outer edge formed in the lowerportion, a V-shaped recessed portion for coming into contact with thenose of the user wearing the goggle apparatus 150 is formed.

The lens 153 includes a pair of a left-eye lens 153L and a right-eyelens 153R, and for example, is a pair of Fresnel lenses. The left-eyelens 153L and the right-eye lens 153R are fitted into the lens frames ofthe lens frame member 152. Specifically, the left-eye lens 153L isfitted into one of the lens frames opened so as not to hinder the fieldof view for the left-eye image IML displayed on the display 12 of themain body apparatus 2 attached to the main body 151. When the user looksinto the left-eye lens 153L with their left eye, the user can view theleft-eye image IML. Further, the right-eye lens 153R is fitted into theother lens frame opened so as not to hinder the field of view for theright-eye image IMR displayed on the display 12 of the main bodyapparatus 2 attached to the main body 151. When the user looks into theright-eye lens 153R with their right eye, the user can view theright-eye image IMR. It should be noted that typically, the left-eyelens 153L and the right-eye lens 153R may be circular or ellipticalmagnifying lenses, and may be lenses that distort images and cause theuser to visually confirm the images. For example, the left-eye lens 153Lmay distort the left-eye image IML (described below) displayed distortedinto a circular or elliptical shape, in a direction opposite to thedistortion of the image and cause the user to visually confirm theimage, and the right-eye lens 153R may distort the right-eye image IMR(described below) displayed distorted into a circular or ellipticalshape, in a direction opposite to the distortion of the image and causethe user to visually confirm the image, whereby the user maystereoscopically view the images. Further, a configuration may beemployed in which the left-eye lens 153L and the right-eye lens 153R areintegrally formed.

The main body 151 includes the abutment portion provided protruding fromthe front surface side of the main body 151 to outside by surroundingthe outer edges of the lens frame member 152 in an angular tube shape.In the abutment portion, an end surface protruding from the frontsurface side to outside is disposed on the near side of the lens 153when the lens 153 is viewed from outside the goggle apparatus 150. Theend surface is placed furthest on the near side (furthest in a negativez-axis direction) of the goggle apparatus 150 in the state where themain body apparatus 2 is attached. Then, the end surface of the abutmentportion of the main body 151 has a shape that fits the face of the user(typically, the periphery of both eyes of the user) when the user looksinto the goggle apparatus 150 to which the main body apparatus 2 isattached. The end surface has the function of fixing the positionalrelationships between the eyes of the user and the lens 153 by abuttingthe face of the user.

Further, when the user views a three-dimensional image displayed on thedisplay 12 using the image display system, the abutment portion canblock external light on the left-eye lens 153L and the right-eye lens153R. This can improve a sense of immersion for the user viewing thethree-dimensional image displayed on the display 12. It should be notedthat when blocking light, the abutment portion does not need tocompletely block external light. For example, as shown in FIG. 15, in apart of the abutment portion formed into a tubular shape, a recess maybe formed. It should be noted that the recess of the abutment portionexemplified in FIG. 15 is formed at the position of a lower portion ofthe midpoint between the left-eye lens 153L and the right-eye lens 153R.This is a position that the nose of the user viewing thethree-dimensional image displayed on the display 12 abuts. That is, therecess of the abutment portion can avoid the strong abutment between theabutment portion and the nose of the user. Even if the light blockingeffect somewhat deteriorates, a feeling of discomfort regarding theabutment between the abutment portion and the nose can be reduced.

As shown in FIG. 10, the plate-like member 154 is fixedly providedwithin the main body 151, which is a portion between the lens framemember 152 and the display 12 when the main body apparatus 2 is attachedto the attachment portion of the main body 151. For example, a part ofthe plate-like member 154 has a shape along the V-shaped recessedportion of the lens frame member 152 and is placed as a wall(hereinafter referred to as a “first wall portion”) connecting betweenthe recessed portion and the display 12 of the main body apparatus 2attached to the main body 151. Then, a space surrounded by the firstwall portion is an opening portion 154 h that exposes a part of thedisplay 12 of the main body apparatus 2 attached to the main body 151 tooutside and functions as an operation window that enables the user toperform a touch operation on the part through the space. It should benoted that a part of the first wall portion of the plate-like member 154may open as shown in FIG. 12.

Further, as shown in FIG. 12, as an example, the plate-like member 154is provided standing in a vertical direction between the left-eye lens153L and the right-eye lens 153R and placed as a wall (hereinafterreferred to as a “second wall portion”) connecting between the recessedportion and the display 12 of the main body apparatus 2 attached to themain body 151. Then, the second wall portion is disposed between theleft-eye image IML and the right-eye image IMR displayed on the display12, so as to divide the images in the state where the main bodyapparatus 2 is attached to the main body 151. The second wall portionfunctions as a division wall provided between the left-eye image IML andthe right-eye image IMR. Then, the plate-like member 154 is provided byextending the first wall portion to the second wall portion, and thefirst wall portion and the second wall portion are formed of integratedmembers.

In FIGS. 10, 13, 14, and 15, the image display system is formed byattaching the main body apparatus 2 to the goggle apparatus 150. Here,in the exemplary embodiment, the main body apparatus 2 is attached suchthat the entirety of the main body apparatus 2 is covered by the goggleapparatus 150. Then, when the main body apparatus 2 is attached to thegoggle apparatus 150, the user can view only the left-eye image IMLdisplayed in a left area of the display 12 through the left-eye lens153L and can view only the right-eye image IMR displayed in a right areaof the display 12 through the right-eye lens 153R. Thus, by viewing theleft-eye lens 153L with their left eye and viewing the right-eye lens153R with their right eye, the user of the image display system canvisually confirm the left-eye image IML and the right-eye image IMR.Thus, by displaying the left-eye image IML and the right-eye image IMRhaving parallax with each other on the display 12, it is possible todisplay a three-dimensional image having a stereoscopic effect to theuser.

As shown in FIGS. 14 and 15, when the user views the three-dimensionalimage displayed on the display 12 while holding the image display systemobtained by attaching the main body apparatus 2 to the goggle apparatus150, the user can hold with their left hand a left side portion of thegoggle apparatus 150 to which the main body apparatus 2 is attached, andcan hold a right side portion of the goggle apparatus 150 with theirright hand. The user thus holds the left and right side portions of thegoggle apparatus 150, whereby it is possible to maintain the state wherethe main body apparatus 2 is stably attached.

Further, in the image display system, even in the state where the mainbody apparatus 2 is attached to the goggle apparatus 150, a touchoperation can be performed on a part of the touch panel 13 provided onthe screen of the display 12, through the opening portion 154 h formedsurrounded by the first wall portion of the plate-like member 154 (athird area of the display 12 described below). Further, based on thedetection results of the acceleration sensor 89 and/or the angularvelocity sensor 90 provided in the main body apparatus 2, the imagedisplay system can calculate information regarding the motion and/or theorientation of the main body apparatus 2, i.e., the motion and/or theorientation of the image display system including the goggle apparatus150. Thus, the image display system can calculate the orientation basedon the direction of gravity of the head of the user looking into thegoggle apparatus 150 to which the main body apparatus 2 is attached.Further, when the orientation or the direction of the head of the userlooking into the goggle apparatus 150 to which the main body apparatus 2is attached changes, the image display system can calculate thedirection or the angle of the change.

Further, when the user looking into the goggle apparatus 150 to whichthe main body apparatus 2 is attached vibrates the image display systemby hitting the image display system, the image display system can detectthe vibration. Thus, when the user views the three-dimensional imagedisplayed on the display 12 through the left-eye lens 153L and theright-eye lens 153R in the state the main body apparatus 2 is attachedto the goggle apparatus 150, a play style is achieved in which a touchoperation through the opening portion 154 h, an operation based on theorientation based on the direction of gravity of the image displaysystem, the operation of changing the orientation of the image displaysystem, and the operation of vibrating the image display system can beperformed.

It should be noted that when the image display system according to theexemplary embodiment is used, an operation may be performed using atleast one of the left controller 3 and the right controller 4 detachedfrom the main body apparatus 2. For example, when the image displaysystem is operated using the left controller 3, the user views thethree-dimensional image displayed on the display 12, while holding thegoggle apparatus 150 to which the main body apparatus 2 is attached withtheir right hand, and also performs the operation while holding thedetached left controller 3 alone with their left hand. In this case,operation information regarding the operations performed on the leftcontroller 3 and/or the right controller 4 detached from the main bodyapparatus 2 is transmitted to the main body apparatus 2 through wirelesscommunication with the main body apparatus 2. Specifically, theoperation information regarding the operation performed on the leftcontroller 3 is wirelessly transmitted from the communication controlsection 101 of the left controller 3 and received by the controllercommunication section 83 of the main body apparatus 2. Further, theoperation information regarding the operation performed on the rightcontroller 4 is wirelessly transmitted from the communication controlsection 111 of the right controller 4 and received by the controllercommunication section 83 of the main body apparatus 2.

As described above, in the exemplary embodiment, a portable imagedisplay system where the user views a three-dimensional image whileholding the portable image display system can be formed by attaching themain body apparatus 2 to the goggle apparatus 150. Further, in the imagedisplay system according to the exemplary embodiment, the user views thethree-dimensional image displayed on the display 12 of the main bodyapparatus 2, while causing the face of the user to abut the goggleapparatus 150. Thus, the positional relationships between stereospeakers (the left speaker 88L and the right speaker 88R) provided inthe main body apparatus 2 and the ears of the user are also fixed, andthe left and right speakers are placed near the ears of the users. Thus,the main body apparatus 2 can output sounds based on the positionalrelationships between a sound output apparatus and the ears of a viewerwithout forcing the viewer to use earphones or speakers. For example,the main body apparatus 2 can control a sound source using so-called 3Daudio effect technology based on the positional relationships betweenthe sound output apparatus and the ears of the viewer.

Next, with reference to FIGS. 9, 10, and 16, a description is given ofimages displayed on the main body apparatus 2. It should be noted thatFIG. 16 is a diagram showing examples of images displayed on the mainbody apparatus 2 in a stereoscopic display mode and a non-stereoscopicdisplay mode.

The image display system according to the exemplary embodiment is set toeither of a stereoscopic display mode used to stereoscopically view animage displayed on the display 12 by attaching the main body apparatus 2to the goggle apparatus 150, and a non-stereoscopic display mode used todirectly view an image displayed on the display 12 by detaching the mainbody apparatus 2 from the goggle apparatus 150, therebynon-stereoscopically viewing the image. Then, the image display systemdisplays the image corresponding to the set mode on the display 12 ofthe main body apparatus 2. Here, the stereoscopic image to bestereoscopically viewed may be stereoscopically viewed by the userviewing a right-eye image and a left-eye image having parallax with eachother with their right eye and left eye. In this case, thenon-stereoscopic image to be non-stereoscopically viewed is an imageother than that of the above two-image display (stereoscopic display),and typically, may be viewed by the user viewing a single image withtheir right eye and left eye. It should be noted that in the exemplaryembodiment, the non-stereoscopic display mode is used as an example of afirst display mode. Further, in the exemplary embodiment, thestereoscopic display mode is used as an example of a second displaymode.

In the stereoscopic display mode, the image display system forms acontent image as a display target (e.g., an image for displaying a partof a virtual space or real space) using the left-eye image IML and theright-eye image IMR having parallax with each other, displays theleft-eye image IML in the left area of the display 12, and displays theright-eye image IML in the right area of the display 12. Specifically,as shown in FIG. 9, in the stereoscopic display mode, the left-eye imageIML is displayed in a first area, which is an approximately ellipticalarea that can be viewed through the left-eye lens 153L when the mainbody apparatus 2 is attached to the goggle apparatus 150, and is also apart of the left area of the display 12. Further, in the stereoscopicdisplay mode, the right-eye image IMR is displayed in a second area,which is an approximately elliptical area that can be viewed through theright-eye lens 153R when the main body apparatus 2 is attached to thegoggle apparatus 150, and is also a part of the right area of thedisplay 12.

Here, as described above, in the state where the main body apparatus 2is attached to the goggle apparatus 150, the second wall portion of theplate-like member 154 is placed between the left-eye image IML displayedin the first area of the display 12 and the right-eye image IMRdisplayed in the second area of the display 12. Thus, the left-eye imageIML and the right-eye image IMR are divided by the second wall portionof the plate-like member 154 as a division wall. Thus, it is possible toprevent the right-eye image IMR from being visually confirmed throughthe left-eye lens 153L, or the left-eye image IML from being visuallyconfirmed through the right-eye lens 153R.

As an example, images of the virtual space viewed from a pair of virtualcameras (a left virtual camera and a right virtual camera) havingparallax with each other and placed in the virtual space are generatedas the left-eye image IML and the right-eye image IMR. The pair ofvirtual cameras is placed in the virtual space, corresponding to theorientation of the main body apparatus 2 based on the direction ofgravity in real space. Then, the pair of virtual cameras changes itsorientation in the virtual space, corresponding to a change in theorientation of the main body apparatus 2 in real space and controls thedirection of the line of sight of the virtual cameras in accordance withthe orientation of the main body apparatus 2. Consequently, by theoperation of changing the orientation of the main body apparatus 2 (theimage display system) to look around, the user wearing the image displaysystem can change the display range of the virtual space to bestereoscopically viewed, can look over the virtual space that isstereoscopically viewed, and therefore can have an experience as ifactually being at the location of the virtual cameras. It should benoted that in the exemplary embodiment, the main body apparatus 2matches the direction of a gravitational acceleration acting on the mainbody apparatus 2 and the direction of gravity in the virtual spaceacting on the virtual cameras and also matches the amount of change inthe orientation of the main body apparatus 2 and the amount of change inthe direction of the line of sight of the virtual cameras. Thisincreases the reality of the operation of looking over the virtual spaceto be stereoscopically viewed based on the orientation of the main bodyapparatus 2.

Further, the image display system displays on the display 12 a userinterface image IMU for receiving a touch operation on the touch panel13 of the main body apparatus 2. For example, a user interface imageIMUa displayed in the stereoscopic display mode is displayed in thedisplay area of the display 12 where a touch operation can be performedthrough the opening portion 154 h of the goggle apparatus 150. Forexample, as described above, the opening portion 154 h is formedsurrounded by the first wall portion of the plate-like member 154 andenables a touch operation on a part of the display 12 of the main bodyapparatus 2 attached to the goggle apparatus 150 (specifically, an areanear the center of the lower portion of the display 12) through theV-shaped recessed portion of the lens frame member 152 that abuts thenose of the user. As an example, as shown in FIG. 9, even in the statewhere the main body apparatus 2 is attached to the goggle apparatus 150,the opening portion 154 h enables a touch operation on a third area setin the lower portion of the display 12 sandwiched between the first areaand the second area of the display 12.

For example, in the stereoscopic display mode, two user interface imagesIMUa1 and IMUa2 are displayed in the third area of the display 12. As anexample, the user interface image IMUa1 is an operation icon for, whenits display position is subjected to a touch operation through the touchpanel 13, giving an operation instruction to retry a game from thebeginning. Further, the user interface image IMUa2 is an operation iconfor, when its display position is subjected to a touch operation throughthe touch panel 13, giving an operation instruction to end the game.Then, the two user interface images IMUa1 and IMUa2 are displayed nextto each other in the third area of the display 12, in sizes matching theshape of the third area. Consequently, the user can give a plurality ofoperation instructions based on touch operations by performing a touchoperation on either of the two user interface images IMUa1 and IMUa2through the opening portion 154 h even in the state where the main bodyapparatus 2 is attached to the goggle apparatus 150. It should be notedthat the two user interface images IMUa1 and IMUa2 may be displayed nearthe third area that enables a touch operation by exposing a part of thedisplay 12 to outside. That is, parts of the two user interface imagesIMUa1 and/or IMUa2 may be displayed outside the third area. It should benoted that in the exemplary embodiment, the user interface image IMUa isused as an example of a second user interface image.

The two user interface images IMUa1 and IMUa2 are images displayed inthe stereoscopic display mode and are displayed in the third areaoutside the first area that can be viewed with the left eye of the userand the second area that can be viewed with the right eye of the user inthe display 12 of the main body apparatus 2 attached to the goggleapparatus 150. That is, the user interface images IMUa1 and IMUa2displayed in the third area are displayed outside the field of view ofthe user visually confirming the user interface images IMUa1 and IMUa2through the goggle apparatus 150, do not include two images havingparallax with each other, and therefore are displayed asnon-stereoscopic images that cannot be stereoscopically viewed. Further,the user interface images IMUa1 and IMUa2 as targets of touch operationsare displayed outside the first area and the second area for displayinga stereoscopic image, and therefore, the first area and the second areaare less likely to be subjected to a touch operation.

Thus, it is possible to prevent the first area and the second area fordisplaying a stereoscopic image from being defaced by the display 12being subjected to a touch operation, and also prevent a finger forperforming a touch operation from entering the field of view in thestate where the stereoscopic image is viewed.

It should be noted that in another exemplary embodiment, the userinterface images IMUa1 and IMUa2 may be displayed on the display 12 as astereoscopic image that can be stereoscopically viewed in thestereoscopic display mode. In this case, the user interface images IMUa1and IMUa2 are displayed on the display 12 as a stereoscopic image byincluding two images having parallax with each other. Typically, one ofimages to be stereoscopically viewed is displayed in a part of the firstarea, and the other image to be stereoscopically viewed is displayed ina part of the second area.

As shown in FIG. 16, in the non-stereoscopic display mode, the imagedisplay system forms the above content image as the display target usinga single image IMS as a non-stereoscopic image, and as an example,displays the single image IMS in the entirety of the display area of thedisplay 12.

As an example, an image of the virtual space viewed from a singlevirtual camera placed in the virtual space is generated as the singleimage IMS. The single virtual camera is placed in the virtual space,corresponding to the orientation of the main body apparatus 2 based onthe direction of gravity in real space. Then, the single virtual camerachanges its orientation in the virtual space, corresponding to a changein the orientation of the main body apparatus 2 in real space andcontrols the direction of the line of sight of the virtual camera inaccordance with the orientation of the main body apparatus 2.Consequently, by the operation of changing the orientation of the mainbody apparatus 2 to look around, the user holding the main bodyapparatus 2 detached from the goggle apparatus 150 can look over thevirtual space by changing the display range of the virtual spacedisplayed on the display 12, and therefore can have an experience as ifactually being at the location of the virtual camera. It should be notedthat in the exemplary embodiment, also in the non-stereoscopic displaymode, the main body apparatus 2 matches the direction of a gravitationalacceleration acting on the main body apparatus 2 and the direction ofgravity in the virtual space acting on the virtual camera and alsomatches the amount of change in the orientation of the main bodyapparatus 2 and the amount of change in the direction of the line ofsight of the virtual camera. This also increases the reality of theoperation of looking over the virtual space to be non-stereoscopicviewed based on the orientation of the main body apparatus 2. It shouldbe noted that in the exemplary embodiment, the single image IMS is usedas an example of a non-stereoscopic image.

Further, a user interface image IMUb displayed in the non-stereoscopicdisplay mode is displayed on the display 12 in a superimposed manner on,for example, the content image (the single image IMS) displayed on thedisplay 12. For example, as shown in FIG. 16, also in thenon-stereoscopic display mode, two user interface images IMUb1 and IMUb2are displayed on the display 12. As an example, the user interface imageIMUb1 is an image corresponding to the user interface image IMUa1 and isan operation icon for, when its display position is subjected to a touchoperation through the touch panel 13, giving an operation instruction toretry a game from the beginning. Further, the user interface image IMUb2is an image corresponding to the user interface image IMUa2 and is anoperation icon for, when its display position is subjected to a touchoperation through the touch panel 13, giving an operation instruction toend the game. Here, the image corresponding to the user interface imageIMUa indicates that the design and/or the size of the image aredifferent from those of the user interface image IMUa, but the functionof the image is substantially the same (e.g., the content of anoperation instruction given by performing a touch operation on the imageis the same) as that of the user interface image IMUa. It should benoted that the image corresponding to the user interface image IMUa maynot only have substantially the same function as that of the userinterface image IMUa displayed in the non-stereoscopic display mode, butalso have the same design and size as those of the user interface imageIMUa, i.e., the image may be completely the same as the user interfaceimage IMUa. It should be noted that in the exemplary embodiment, theuser interface image IMUb is used as an example of a first userinterface image.

The two user interface images IMUb1 and IMUb2 are displayed in cornerareas (e.g., an upper left corner area and an upper right corner area)of the display 12 that are different from the third area. It should benoted that areas where touch operations can be performed on the two userinterface images IMUb1 and IMUb2 are not limited, and therefore, the twouser interface images IMUb1 and IMUb2 can be displayed larger than theuser interface image IMUa displayed in the stereoscopic display mode andcan be displayed in sizes and shapes that facilitate a touch operationof the user and at positions where the visibility of the content image(the single image IMS) is unlikely to be impaired by a touch operation.

Based on the result of detecting whether or not the main body apparatus2 is in an attached state where the main body apparatus 2 is attached tothe goggle apparatus 150, or whether or not the main body apparatus 2 isin a halfway attached state where the main body apparatus 2 is beingattached to the goggle apparatus 150, the image display system accordingto the exemplary embodiment can automatically switch the stereoscopicdisplay mode and the non-stereoscopic display mode. For example, in themain body apparatus 2, the illuminance sensor 29 is provided thatdetects the illuminance (brightness) of light incident on the mainsurface side of the housing 11. Based on the detection result of theilluminance by the illuminance sensor 29, the main body apparatus 2 candetect whether or not the main body apparatus 2 is in the attached statewhere the main body apparatus 2 is attached to the goggle apparatus 150,or whether or not the main body apparatus 2 is in the halfway attachedstate where the main body apparatus 2 is being attached to the goggleapparatus 150. Specifically, when the main body apparatus 2 is attachedto the goggle apparatus 150, or when the main body apparatus 2 is in thehalfway attached state, the illuminance detected by the illuminancesensor 29 decreases. Thus, a threshold allowing the detection of thedecreased illuminance is provided, and it is detected whether or not theilluminance is greater than or equal to the threshold. Thus, it ispossible to detect whether or not the main body apparatus 2 is in theattached state, or whether or not the main body apparatus 2 is in thehalfway attached state. Here, “the fact that the main body apparatus 2is in the attached state” detected by the main body apparatus 2 based onthe detection result of the illuminance by the illuminance sensor 29 isthe fact that the main body apparatus 2 is in the state where the mainbody apparatus 2 is completely attached to the goggle apparatus 150.Further, “the fact that the main body apparatus 2 is in the halfwayattached state” detected by the main body apparatus 2 based on thedetection result of the illuminance by the illuminance sensor 29 is thefact that the main body apparatus 2 is in the state where the main bodyapparatus 2 is at a stage prior to the state where the main bodyapparatus 2 is completely attached to the goggle apparatus 150.

When the illuminance sensor 29 detects whether or not the main bodyapparatus 2 is in the attached state, or whether or not the main bodyapparatus 2 is in the halfway attached state, a plurality of forms arepossible. As a first example, as shown in FIG. 11, in the attachmentportion of the goggle apparatus 150 for detachably fixing the main bodyapparatus 2, when the front surface abutment portion 151 b of the mainbody 151 in surface contact with a part of the front surface (thesurface on which the display 12 is provided) of the main body apparatus2 in the attached state is formed by covering a light-receiving surfaceor a light-receiving hole of the illuminance sensor 29, the frontsurface abutment portion 151 b enters the state where the front surfaceabutment portion 151 b covers the light-receiving surface or thelight-receiving hole of the illuminance sensor 29, whereby it isdetected whether or not the main body apparatus 2 is in the attachedstate where the main body apparatus 2 is attached to the goggleapparatus 150, or whether or not the main body apparatus 2 is in thehalfway attached state where the main body apparatus 2 is being attachedto the goggle apparatus 150. As an example, when the light-receivingsurface or the light-receiving hole of the illuminance sensor 29 isprovided in a corner portion of the main body apparatus 2, and if themain body apparatus 2 is inserted into the attachment portion of thegoggle apparatus 150 from the corner portion side, the light-receivingsurface or the light-receiving hole enters the state where thelight-receiving surface or the light-receiving hole is covered by thefront surface abutment portion 151 b in an early period of thisattachment operation. Thus, based on the detection result of theilluminance by the illuminance sensor 29, it is possible to detect thatthe main body apparatus 2 “is in the halfway attached state”. Further,if the main body apparatus 2 is inserted into the attachment portion ofthe goggle apparatus 150 from the side surface side opposite to thecorner portion where the light-receiving surface or the light-receivinghole of the illuminance sensor 29 is provided, the light-receivingsurface or the light-receiving hole enters the state where thelight-receiving surface or the light-receiving hole is covered by thefront surface abutment portion 151 b in a terminal period of thisattachment operation. Thus, based on the detection result of theilluminance by the illuminance sensor 29, it is possible to detect thatthe main body apparatus 2 “is in the attached state”. As anotherexample, when the light-receiving surface or the light-receiving hole ofthe illuminance sensor 29 is provided on the center side of the lowerportion of the main body apparatus 2, and if the main body apparatus 2is inserted into the attachment portion of the goggle apparatus 150, thelight-receiving surface or the light-receiving hole enters the statewhere the light-receiving surface or the light-receiving hole is coveredby the front surface abutment portion 151 b from an early period to anintermediate period of this attachment operation, no matter whichdirection the main body apparatus 2 is inserted from. Thus, based on thedetection result of the illuminance by the illuminance sensor 29, it ispossible to detect that the main body apparatus 2 “is in the halfwayattached state”. It should be noted that in the first example, the frontsurface abutment portion 151 b of the main body 151 is used as anexample of a light-shielding portion.

As a second example, even when the front surface abutment portion 151 bis not formed by covering the light-receiving surface or thelight-receiving hole of the illuminance sensor 29, using the fact thatthe inside of the main body 151 is relatively dark, it is detectedwhether or not the main body apparatus 2 is in the attached state wherethe main body apparatus 2 is attached to the goggle apparatus 150, orwhether or not the main body apparatus 2 is in the halfway attachedstate where the main body apparatus 2 is being attached to the goggleapparatus 150. For example, the state where external light is incidenton the inside of the main body 151 of the goggle apparatus 150 throughthe left-eye lens 153L and the right-eye lens 153R is possible. Even inthis state, the attached state of the main body apparatus 2 is detectedby detecting that the illuminance is greater than that outside the mainbody 151. As an example, when the light-receiving surface or thelight-receiving hole of the illuminance sensor 29 is provided in acorner portion of the main body apparatus 2, and if the main bodyapparatus 2 is inserted into the attachment portion of the goggleapparatus 150 from the corner portion side, the light-receiving surfaceor the light-receiving hole is inserted into the main body 151 in anearly period of this attachment operation. Thus, based on the detectionresult of the illuminance by the illuminance sensor 29, it is possibleto detect that the main body apparatus 2 “is in the halfway attachedstate”. Further, if the main body apparatus 2 is inserted into theattachment portion of the goggle apparatus 150 from the side surfaceside opposite to the corner portion where the light-receiving surface orthe light-receiving hole of the illuminance sensor 29 is provided, thelight-receiving surface or the light-receiving hole is inserted into themain body 150 in a terminal period of this attachment operation. Thus,based on the detection result of the illuminance by the illuminancesensor 29, it is possible to detect that the main body apparatus 2 “isin the attached state”. As another example, when the light-receivingsurface or the light-receiving hole of the illuminance sensor 29 isprovided on the center side of the lower portion of the main bodyapparatus 2, and if the main body apparatus 2 is inserted into theattachment portion of the goggle apparatus 150, the light-receivingsurface or the light-receiving hole is inserted into the main body 151from an early period to an intermediate period of this attachmentoperation, no matter which direction the main body apparatus 2 isinserted from. Thus, based on the detection result of the illuminance bythe illuminance sensor 29, it is possible to detect that the main bodyapparatus 2 “is in the halfway attached state”. It should be noted thatin the second example, the main body 151 is used as another example ofthe light-shielding portion.

As a third example, even when the front surface abutment portion 151 bis not formed by covering the light-receiving surface or thelight-receiving hole of the illuminance sensor 29, using the fact thatthe inside of the main body 151 darkens by the user wearing the goggleapparatus 150 to which the main body apparatus 2 is attached, it isdetected that the main body apparatus 2 is in the attached state wherethe main body apparatus 2 is attached to the goggle apparatus 150. Forexample, in the state where the user does not wear the goggle apparatus150, it is possible that external light is incident on the main body 151of the goggle apparatus 150 through the left-eye lens 153L and theright-eye lens 153R. In this case, the external light incident throughthe left-eye lens 153L and the right-eye lens 153R is blocked by theuser wearing the goggle apparatus 150. Thus, the attached state of themain body apparatus 2 can be detected by detecting that the illuminanceof the inside of the main body 151 decreases. As an example, when lightincident on the light-receiving surface or the light-receiving hole ofthe illuminance sensor 29 placed in the main body 151 of the goggleapparatus 150 is blocked by the main body 151 and the face of the user,based on the detection result of the illuminance by the illuminancesensor 29, it is possible to detect that the main body apparatus 2 “isin the attached state”. Further, in this example, it is possible todetect not only whether or not the main body apparatus 2 is in theattached state where the main body apparatus 2 is attached to the goggleapparatus 150, but also whether or not the user wears the goggleapparatus 150 to which the main body apparatus 2 is attached. It shouldbe noted that in the third example, the main body 151 is used as anotherexample of the light-shielding portion.

When it is determined that the main body apparatus 2 is not in the statewhere the main body apparatus 2 is attached to the goggle apparatus 150,the image display system according to the exemplary embodiment sets thedisplay mode of the main body apparatus 2 to the non-stereoscopicdisplay mode. On the other hand, in the main body apparatus 2 set to thenon-stereoscopic display mode, when it is determined that the main bodyapparatus 2 changes from a non-attached state where the main bodyapparatus 2 is not attached to the goggle apparatus 150 to the attachedstate where the main body apparatus 2 is attached to the goggleapparatus 150, the main body apparatus 2 changes the content image of adisplayed non-stereoscopic image to a stereoscopic image, therebydisplaying the same content image on the display 12. As an example, whenthe single virtual camera is set in the virtual space to display thesingle image IMS in the non-stereoscopic display mode, and a virtualspace image is generated, the main body apparatus 2 sets virtual camerasfor displaying the left-eye image IML and the right-eye image IMR bychanging the single virtual camera to the pair of virtual cameras (theleft virtual camera and the right virtual camera) having parallax witheach other, without changing the position and the direction of the lineof sight of the single virtual camera, thereby switching to thegeneration of a virtual space image in the stereoscopic display mode.Further, in the main body apparatus 2 set to the stereoscopic displaymode, when it is determined that the main body apparatus 2 changes fromthe attached state where the main body apparatus 2 is attached to thegoggle apparatus 150 to the non-attached state where the main bodyapparatus 2 is not attached to the goggle apparatus 150, the main bodyapparatus 2 changes the content image of a displayed stereoscopic imageto a non-stereoscopic image, thereby displaying the same content imagecorresponding to the content image of the stereoscopic image, as anon-stereoscopic image on the display 12. As an example, when the pairof virtual cameras is set in the virtual space to display the left-eyeimage IML and the right-eye image IMR in the stereoscopic display mode,and a virtual space image is generated, the main body apparatus 2 sets avirtual camera for displaying the single image IMS by changing the pairof virtual cameras to the single virtual camera without changing theposition and the direction of the line of sight of the pair of virtualcameras, thereby switching to the generation of a virtual space image inthe non-stereoscopic display mode. As described above, the content imageof a non-stereoscopic image (e.g., a virtual space image) correspondingto the content image of a stereoscopic image (e.g., a virtual spaceimage) or the content image of a stereoscopic image (e.g., a virtualspace image) corresponding to the content image of a non-stereoscopicimage (e.g., a virtual space image) indicates that there is only adifference between a stereoscopic image and a non-stereoscopic image ineither case. However, the content image of a non-stereoscopic imagecorresponding to the content image of a stereoscopic image and thecontent image of a stereoscopic image corresponding to the content imageof a non-stereoscopic image may be different in display range.Typically, the content image of a stereoscopic image may have a displayrange smaller than that of the content image of a non-stereoscopicimage.

Further, when the display mode is switched, the image display systemaccording to the exemplary embodiment changes the size, the shape, andthe position of the user interface image IMU and displays the userinterface image IMU on the display 12. For example, in the main bodyapparatus 2 set to the non-stereoscopic display mode, when it isdetermined that the main body apparatus 2 changes from the non-attachedstate where the main body apparatus 2 is not attached to the goggleapparatus 150 to the attached state where the main body apparatus 2 isattached to the goggle apparatus 150, the main body apparatus 2 changesthe shapes of the user interface images IMUb1 and IMUb2 displayed in asuperimposed manner on the content image in the corner areas of thedisplay 12 to the user interface images IMUa1 and IMUa2 and also movesthe display positions of the user interface images IMUa1 and IMUa2 tothe third area of the display 12, thereby displaying the user interfaceimage IMU having the same function. Further, in the main body apparatus2 set to the stereoscopic display mode, when it is determined that themain body apparatus 2 changes from the attached state where the mainbody apparatus 2 is attached to the goggle apparatus 150 to thenon-attached state where the main body apparatus 2 is not attached tothe goggle apparatus 150, the main body apparatus 2 changes the shapesof the user interface images IMUa1 and IMUa2 displayed in the third areaof the display 12 to the user interface images IMUb1 and IMUb2 and alsomoves the display positions of the user interface images IMUb1 and IMUb2so that the user interface images IMUb1 and IMUb2 are displayed in asuperimposed manner on the content image in the corner areas of thedisplay 12, thereby displaying the user interface image IMU having thesame function.

It should be noted that in the above exemplary embodiment, an examplehas been used where based on the detection result of the illuminance bythe illuminance sensor 29, it is detected whether or not the main bodyapparatus 2 is in the attached state where the main body apparatus 2 isattached to the goggle apparatus 150, or whether or not the main bodyapparatus 2 is in the halfway attached state where the main bodyapparatus 2 is being attached to the goggle apparatus 150.Alternatively, based on another detection result, it may be detectedwhether or not the main body apparatus 2 is in the attached state wherethe main body apparatus 2 is attached to the goggle apparatus 150, orwhether or not the main body apparatus 2 is in the halfway attachedstate where the main body apparatus 2 is being attached to the goggleapparatus 150. As an example, based on a detection result obtained by aconnection terminal provided in the main body apparatus 2 and aconnection terminal provided in the goggle apparatus 150 beingelectrically connected together by the main body apparatus 2 enteringthe attached state or the halfway attached state, or a detection resultobtained by a predetermined switch mechanism provided in the main bodyapparatus 2 being turned on or off by the main body apparatus 2 enteringthe attached state or the halfway attached state, it may be detectedwhether or not the main body apparatus 2 is in the attached state wherethe main body apparatus 2 is attached to the goggle apparatus 150, orwhether or not the main body apparatus 2 is in the halfway attachedstate where the main body apparatus 2 is being attached to the goggleapparatus 150. As another example, based on the image capturing resultof image capturing means (an image sensor) provided in the main bodyapparatus 2, it may be determined whether or not a predetermined imageis captured, or it may be determined whether or not captured luminanceis greater than or equal to a threshold, thereby detecting whether ornot the main body apparatus 2 is in the attached state where the mainbody apparatus 2 is attached to the goggle apparatus 150, or detectingwhether or not the main body apparatus 2 is in the halfway attachedstate where the main body apparatus 2 is being attached to the goggleapparatus 150. Further, as another example, when the main body apparatus2 enters the attached state where the main body apparatus 2 is attachedto the goggle apparatus 150, or the halfway attached state where themain body apparatus 2 is being attached to the goggle apparatus 150, theuser may be urged to perform a predetermined operation. Then, based onthe fact that the predetermined operation is performed, it may bedetected whether or not the main body apparatus 2 is in the attachedstate where the main body apparatus 2 is attached to the goggleapparatus 150, or whether or not the main body apparatus 2 is in thehalfway attached state where the main body apparatus 2 is being attachedto the goggle apparatus 150.

Further, in the above exemplary embodiment, the third area is set in alower portion of the display 12 on the lower side of the center of thedisplay 12 sandwiched between the first area and the second area of thedisplay 12, thereby enabling a touch operation on the third area.Alternatively, the third area may be set in another area of the display12. As a first example, the third area may be set in an upper portion ofthe display 12 on the upper side of the center of the display 12sandwiched between the first area and the second area of the display 12.As a second example, the third area may be set in an upper portion(i.e., the upper left corner area of the display 12) or a lower portion(i.e., a lower left corner area of the display 12) sandwiched betweenthe first area of the display 12 and the left end of the display 12. Asa third example, the third area may be set in an upper portion (i.e.,the upper right corner area of the display 12) or a lower portion (i.e.,a lower right corner area of the display 12) sandwiched by the secondarea of the display 12 and the right end of the display 12. No matterwhich area the third area is set in, the user interface image IMUamatching the shape of the third area is displayed in the third area, andthe opening portion 154 h that enables a touch operation on the thirdarea is formed in the goggle apparatus 150, thereby enabling anoperation similar to that in the above description. It should be notedthat when the third area is set between the first area and the secondarea sandwiched between the first area and the second area, the thirdarea may be shifted to the left or the right from an intermediateposition between the first area and the second area.

Further, in the above exemplary embodiment, as the function of a userinterface image, the function of a user interface image displayed on thedisplay 12 to receive a touch operation on the touch panel 13 is used asan example. Alternatively, the user interface image that does notreceive a touch operation may be used. For example, the user interfaceimage may be character information, an icon, or the like that does notenable a touch operation, but presents some information to the user. Asan example, the user interface image may be an image representing thecontent of an instruction corresponding to a button operation or a stickoperation on the left controller 3 or the right controller 4, theoperation of moving the controller main body, or the like.

Further, the left-eye image IML and the right-eye image IMR may also bedisplayed outside the display area of the display 12 that can be viewedthrough the left-eye lens 153L and the right-eye lens 153R (typically,outside the first area and/or outside the second area), and parts of theleft-eye image IML and the right-eye image IMR may also be displayed inthe third area where a touch operation can be performed. Further, theleft-eye image IML and the right-eye image IMR may be displayed in arange smaller than that of the display area of the display 12 that canbe viewed through the left-eye lens 153L and the right-eye lens 153R(typically, the first area and/or the second area).

Next, with reference to FIGS. 17 and 18, a description is given of anexample of a specific process executed by the game system 1 in theexemplary embodiment. FIG. 17 is a diagram showing an example of a dataarea set in the DRAM 85 of the main body apparatus 2 in the exemplaryembodiment. It should be noted that in the DRAM 85, in addition to thedata shown in FIG. 17, data used in another process is also stored, butis not described in detail here.

In a program storage area of the DRAM 85, various programs Pa, which areexecuted by the game system 1, are stored. In the exemplary embodiment,as the various programs Pa, a communication program for wirelesslycommunicating with the left controller 3 and the right controller 4, anapplication program for performing information processing (e.g., gameprocessing) based on data acquired from the operation sections (the leftcontroller 3, the right controller 4, the touch panel 13, theacceleration sensor 89, and the angular velocity sensor 90), theilluminance sensor 29, and the like are stored. It should be noted thatthe various programs Pa may be stored in advance in the flash memory 84,or may be acquired from a storage medium attachable to and detachablefrom the game system 1 (e.g., a predetermined type of a storage mediumattached to the slot 23) and stored in the DRAM 85, or may be acquiredfrom another apparatus via a network such as the Internet and stored inthe DRAM 85. The processor 81 executes the various programs Pa stored inthe DRAM 85.

Further, in a data storage area of the DRAM 85, various data used forprocesses such as a communication process and information processingexecuted by the game system 1 is stored. In the exemplary embodiment, inthe DRAM 85, operation data Da, angular velocity data Db, accelerationdata Dc, illuminance data Dd, orientation data De, operation object dataDf, virtual camera data Dg, left-eye virtual space image data Dh,right-eye virtual space image data Di, stereoscopic view UI (userinterface) image data Dj, non-stereoscopic view virtual space image dataDk, non-stereoscopic view UI (user interface) image data Dm, image dataDn, and the like are stored.

The operation data Da is operation data appropriately acquired from eachof the left controller 3 and/or the right controller 4 and the touchpanel 13. As described above, operation data transmitted from each ofthe left controller 3 and/or the right controller 4 and the touch panel13 includes information regarding an input (specifically, informationregarding an operation or the detection result of each sensor) from eachof the input sections (specifically, buttons, analog sticks, andsensors). In the exemplary embodiment, operation data is transmitted ina predetermined cycle from each of the left controller 3 and/or theright controller 4 through wireless communication, and the operationdata Da is appropriately updated using the received operation data. Itshould be noted that the update cycle of the operation data Da may besuch that the operation data Da is updated every frame, which is thecycle of the processing described later executed by the main bodyapparatus 2, or is updated every cycle in which the above operation datais transmitted through the wireless communication. Further, operationdata indicating that the touch panel 13 is operated is acquired in eachcycle of the above processing, stored in the operation data Da inaccordance with the acquisition, and updated.

The angular velocity data Db is data indicating angular velocitiesgenerated in the main body apparatus 2 and detected by the angularvelocity sensor 90. For example, the angular velocity data Db includesdata indicating angular velocities about the xyz axes generated in themain body apparatus 2, and the like.

The acceleration data Dc is data indicating accelerations generated inthe main body apparatus 2 and detected by the acceleration sensor 89.For example, the acceleration data Dc includes data indicatingaccelerations in the xyz axis directions generated in the main bodyapparatus 2, and the like.

The illuminance data Dd is data indicating the illuminance of theperiphery of the main body apparatus 2 detected by the illuminancesensor 29.

The orientation data De is data indicating the orientation of the mainbody apparatus 2 in real space. As an example, the orientation data Deincludes data indicating the orientation based on a gravity vectorindicating a gravitational acceleration generated in the main bodyapparatus 2, and data indicating a change in the orientation of the mainbody apparatus 2.

The operation object data Df is data indicating the position, thedirection, the orientation, the action, and the like in the virtualspace of an object operated by the user.

The virtual camera data Dg is data indicating the position, thedirection, the viewing angle, the magnification, and the like of avirtual camera (the pair of left and right virtual cameras in thestereoscopic display mode and the single virtual camera in thenon-stereoscopic display mode) set in the virtual space.

The left-eye virtual space image data Dh is data for generating theleft-eye image IML in the stereoscopic display mode. The right-eyevirtual space image data Di is data for generating the right-eye imageIMR in the stereoscopic display mode. The stereoscopic view UI imagedata Dj is data indicating the position, the shape, the size, and thelike of the user interface image IMUa in the stereoscopic display mode.

The non-stereoscopic view virtual space image data Dk is data forgenerating the single image IMS in the non-stereoscopic display mode.The non-stereoscopic view UI image data Dm is data indicating theposition, the shape, the size, and the like of the user interface imageIMUb in the non-stereoscopic display mode.

The image data Dn is data for displaying images (e.g., an image of avirtual object, a user interface image, an information image, a fieldimage, a background image, and the like) on the display screen when agame is performed.

Next, with reference to FIG. 18, a detailed example of informationprocessing (game processing) according to the exemplary embodiment isdescribed. FIG. 18 is a flow chart showing an example of game processingexecuted by the game system 1. In the exemplary embodiment, a series ofprocesses shown in FIG. 18 is performed by the processor 81 executing acommunication program or a predetermined application program (a gameprogram) included in the various programs Pa. Further, the informationprocessing shown in FIG. 18 is started at any timing.

It should be noted that the processes of all of the steps in the flowchart shown in FIG. 18 are merely illustrative. Thus, the processingorder of the steps may be changed, or another process may be performedin addition to (or instead of) the processes of all of the steps, solong as similar results are obtained. Further, in the exemplaryembodiment, descriptions are given on the assumption that the processor81 performs the processes of all of the steps in the flow chart.Alternatively, a processor or a dedicated circuit other than theprocessor 81 may perform the processes of some of the steps in the flowchart. Yet alternatively, part of the processing performed by the mainbody apparatus 2 may be executed by another information processingapparatus capable of communicating with the main body apparatus 2 (e.g.,a server capable of communicating with the main body apparatus 2 via anetwork). That is, all the processes shown in FIG. 18 may be executed bythe cooperation of a plurality of information processing apparatusesincluding the main body apparatus 2.

In FIG. 18, the processor 81 performs initialization in the gameprocessing (step S200), and the processing proceeds to the next step.For example, in the initialization, the processor 81 initializesparameters for performing the processing described below. As an example,using acceleration data stored in the acceleration data Dc, theprocessor 81 calculates the direction of a gravity vector of agravitational acceleration acting on the main body apparatus 2 and setsthe initial orientation of the main body apparatus 2 based on thedirection of the gravity vector, thereby updating the orientation dataDe. Further, the processor 81 sets the initial orientation of thevirtual camera in the virtual space so that the direction of the initialorientation of the virtual camera is similar to a direction in therelationships between the direction of the gravity vector of thegravitational acceleration acting on the main body apparatus 2 and thexyz axis directions of the main body apparatus 2, thereby updating thevirtual camera data Dg. Here, being similar to a direction in therelationships of the xyz axes of the main body apparatus 2 means havingsuch a placement relationship that a positive z-axis direction (thedepth direction of the screen) based on the direction of thegravitational acceleration in real space is the same as the direction ofthe line of sight of the virtual camera based on the direction ofgravity in the virtual space, and a positive x-axis direction (the leftdirection of the screen) based on the direction of the gravitationalacceleration in real space is the same as the left direction of thevirtual camera based on the direction of gravity in the virtual space.

Next, the processor 81 acquires various pieces of data and updates theoperation data Da, the angular velocity data Db, the acceleration dataDc, and the illuminance data Dd (step S201), and the processing proceedsto the next step. For example, the processor 81 acquires operation datafrom the left controller 3 and/or the right controller 4 and updates theoperation data Da. Further, the processor 81 acquires touch operationdata from the touch panel 13 and updates the operation data Da. Further,the processor 81 acquires inertia data (acceleration data and angularvelocity data) from the inertial sensors (the acceleration sensor 89 andthe angular velocity sensor 90) provided in the main body apparatus 2and updates the acceleration data Dc and the angular velocity data Db.Further, the processor 81 acquires illuminance data from the illuminancesensor 29 and updates the illuminance data Dd.

Next, the processor 81 calculates the orientation of the main bodyapparatus 2 (step S202), and the processing proceeds to the next step.For example, using the acceleration data and the angular velocity datastored in the angular velocity data Db and the acceleration data Dc, theprocessor 81 calculates the direction of the gravity vector of thegravitational acceleration acting on the main body apparatus 2, therebyupdating the orientation data De. Further, the processor 81 calculatesthe direction of rotation and the amount of rotation from the initialorientation of the main body apparatus 2, thereby updating theorientation data De. For example, the processor 81 calculates thedirection of rotation and the amount of rotation about the xyz axisdirections of the main body apparatus 2 in the initial orientation,thereby updating the orientation data De. It should be noted that thedirection of rotation can be represented by the positivity andnegativity of the amount of rotation. Thus, only data indicating theamount of rotation may be stored in the orientation data De. Forexample, the processor 81 may add the amount of rotation based on theangular velocity data acquired in step S202 in the current processing tothe amount of rotation calculated in step S202 in the previousprocessing, thereby calculating a new amount of rotation.

Next, the processor 81 performs the process of determining whether ornot the main body apparatus 2 is attached to the goggle apparatus 150(step S203), and the processing proceeds to the next step. For example,based on a threshold for detecting the illuminance when the main bodyapparatus 2 is attached to the goggle apparatus 150, when theilluminance indicated by the illuminance data Dd indicates lowilluminance less than the threshold, the processor 81 determines in theabove step S203 that the main body apparatus 2 is attached to the goggleapparatus 150.

Next, the processor 81 determines whether or not the display mode is thestereoscopic display mode (step S204). For example, when it isdetermined in the attachment determination process in the above stepS203 that the main body apparatus 2 is attached to the goggle apparatus150, the determination is affirmative in the above step S204, and theprocessor 81 performs the processing in the stereoscopic display mode.On the other hand, when it is determined in the attachment determinationprocess in the above step S203 that the main body apparatus 2 is notattached to the goggle apparatus 150, the determination is negative inthe above step S204, and the processor 81 performs the processing in thenon-stereoscopic display mode. Then, when the processor 81 performs theprocessing in the stereoscopic display mode, the processing proceeds tostep S205. On the other hand, when the processor 81 performs theprocessing in the non-stereoscopic display mode, the processing proceedsto step S213.

In step S205, the processor 81 performs an object action process, andthe processing proceeds to the next step. For example, with reference tothe operation data Da, when the operation of causing an operation objectin the virtual space to perform an action is performed, the processor 81sets the motion of the operation object corresponding to the operation.Then, based on the set motion of the operation object, the processor 81sets the position, the direction, the orientation, the action, and thelike in the virtual space of the operation object, thereby updating theoperation object data Df.

In the object action process in the above step S205, the followingobject action control is possible. As a first example, using as anoperation target an operation object determined in advance, theoperation object is caused to perform an action. In this case, based oninputs to the input sections of the left controller 3 and/or the rightcontroller 4, the operation object determined in advance is moved,caused to perform an action, or deformed. As a second example, anoperation object is selected as an operation target based on anoperation, and the operation object is caused to perform an action. Inthis case, using as an operation target an operation object placed at apredetermined display position (e.g., an operation object displayed in asuperimposed manner on an indicator displayed at the center of thedisplay screen), based on inputs to the input sections of the leftcontroller 3 and/or the right controller 4, the operation objectselected as the operation target is moved, caused to perform an action,or deformed. As a third example, the operation object as the operationtarget is caused to perform an action based on a vibration to the goggleapparatus 150 to which the main body apparatus 2 is attached. Forexample, a gravitational acceleration component is removed from theaccelerations in the xyz axis directions in the main body apparatus 2indicated by the acceleration data Dc, and when the accelerations afterthe removal indicate that a vibration having a magnitude greater than orequal to a predetermined magnitude is applied to the main body apparatus2, the operation object as the operation target is caused to perform anaction in accordance with the vibration. It should be noted that as themethod for extracting the gravitational acceleration, any method may beused. For example, an acceleration component averagely generated in themain body apparatus 2 may be calculated, and the acceleration componentmay be extracted as the gravitational acceleration.

Next, the processor 81 performs the process of causing the pair of leftand right virtual cameras to operate (step S206), and the processingproceeds to the next step. For example, the processor 81 rotates theorientation of the pair of left and right virtual cameras in the virtualspace by the amount of rotation calculated in step S202 from the initialorientation and sets the orientation, thereby updating the virtualcamera data Dg. For example, in the state where the positionalrelationship between the pair of left and right virtual cameras isfixed, the processor 81 rotates from the initial orientation the virtualcameras about the left-right direction of the virtual cameras by thesame amount as the amount of rotation about the left-right axialdirection (the x-axis direction) of the main body apparatus 2 calculatedin step S202, rotates from the initial orientation the virtual camerasabout the up-down direction of the virtual cameras by the same amount asthe amount of rotation about the up-down axial direction (the y-axisdirection) of the main body apparatus 2 calculated in step S202, androtates from the initial orientation the virtual cameras about thedirection of the line of sight of the virtual cameras by the same amountas the amount of rotation about the screen depth axial direction (thez-axis direction) of the main body apparatus 2 calculated in step S202,thereby setting the orientation of the pair of left and right virtualcameras in the virtual space.

Next, the processor 81 performs the process of generating a left-eyevirtual space image (step S207), and the processing proceeds to the nextstep. For example, based on the operation object data Df, the processor81 places the operation object in the virtual space. Then, the processor81 generates a virtual space image viewed from, between the pair of leftand right virtual cameras set in the virtual camera data Dg, the leftvirtual camera as a left-eye virtual space image, thereby updating theleft-eye virtual space image data Dh.

Next, the processor 81 performs the process of generating a right-eyevirtual space image (step S208), and the processing proceeds to the nextstep. For example, the processor 81 generates a virtual space imageviewed from, between the pair of left and right virtual cameras set inthe virtual camera data Dg, the right virtual camera as a right-eyevirtual space image, thereby updating the right-eye virtual space imagedata Di.

Next, the processor 81 performs the process of generating a stereoscopicview user interface image (step S209), and the processing proceeds tothe next step. For example, the processor 81 generates a stereoscopicview user interface image matching the shape of the third area of thedisplay 12 (see FIG. 9), thereby updating the stereoscopic view UI imagedata Dj.

Next, the processor 81 performs a display control process for displayingthe left-eye virtual space image in the first area of the display 12(step S210), and the processing proceeds to the next step. For example,the processor 81 displays the left-eye virtual space image set in theleft-eye virtual space image data Dh as the left-eye image IML in theentirety of the first area of the display 12 (see FIG. 9).

Next, the processor 81 performs a display control process for displayingthe right-eye virtual space image in the second area of the display 12(step S211), and the processing proceeds to the next step. For example,the processor 81 displays the right-eye virtual space image set in theright-eye virtual space image data Di as the right-eye image IMR in theentirety of the second area of the display 12 (see FIG. 9).

Next, the processor 81 performs a display control process for displayingthe stereoscopic view UI image in the third area of the display 12 (stepS212), and the processing proceeds to step S219. For example, theprocessor 81 displays the user interface image set in the stereoscopicview UI image data Dj as the user interface image IMUa (e.g., the twouser interface images IMUa1 and IMUa2) at a predetermined position inthe third area of the display 12 (see FIG. 9).

On the other hand, when it is determined in the above step S204 that thedisplay mode is the non-stereoscopic display mode, then in step S213,the processor 81 performs an object action process, and the processingproceeds to the next step. For example, with reference to the operationdata Da, when the operation of causing an operation object in thevirtual space to perform an action is performed, the processor 81 setsthe motion of the operation object corresponding to the operation. Then,based on the set motion of the operation object, the processor 81 setsthe position, the direction, the orientation, the action, and the likein the virtual space of the operation object, thereby updating theoperation object data Df. It should be noted that the object actionprocess in the above step S213 is similar to the object action processin step S205 described above, and therefore is not described in detail.

Next, the processor 81 performs the process of causing the singlevirtual camera to operate (step S214), and the processing proceeds tothe next step. For example, the processor 81 rotates the orientation ofthe single virtual camera in the virtual space by the amount of rotationcalculated in step S202 from the initial orientation and sets theorientation, thereby updating the virtual camera data Dg. For example,the processor 81 rotates from the initial orientation the single virtualcamera about the left-right direction of the virtual camera by the sameamount as the amount of rotation about the left-right axial direction(the x-axis direction) of the main body apparatus 2 calculated in stepS202, rotates from the initial orientation the single virtual cameraabout the up-down direction of the virtual camera by the same amount asthe amount of rotation about the up-down axial direction (the y-axisdirection) of the main body apparatus 2 calculated in step S202, androtates from the initial orientation the single virtual camera about thedirection of the line of sight of the virtual camera by the same amountas the amount of rotation about the screen depth axial direction (thez-axis direction) of the main body apparatus 2 calculated in step S202,thereby setting the orientation of the single virtual camera in thevirtual space.

Next, the processor 81 performs the process of generating a virtualspace image (step S215), and the processing proceeds to the next step.For example, the processor 81 generates a virtual space image viewedfrom the virtual camera set in the virtual camera data Dg, therebyupdating the non-stereoscopic view virtual space image data Dk.

Next, the processor 81 performs the process of generating anon-stereoscopic view user interface image (step S216), and theprocessing proceeds to the next step. For example, the processor 81generates a non-stereoscopic view user interface image to be displayedin a superimposed manner on the single image IMS on the display 12 (seeFIG. 16), thereby updating the non-stereoscopic view UI image data Dm.

Next, the processor 81 performs a display control process for displayingthe virtual space image in the entirety area of the display 12 (stepS217), and the processing proceeds to the next step. For example, theprocessor 81 displays the virtual space image set in thenon-stereoscopic view virtual space image data Dk as the single imageIMS in the entirety area of the display 12 (see FIG. 16).

Next, the processor 81 performs a display control process for displayingthe non-stereoscopic view UI image in a superimposed manner on thesingle image IMS (step S218), and the processing proceeds to step S219.For example, the processor 81 displays the user interface image set inthe non-stereoscopic view UI image data Dm as the user interface imageIMUb (e.g., the two user interface images IMUb1 and IMUb2) in asuperimposed manner on the single image IMS in the upper left cornerarea and the upper right corner area of the display 12 (see FIG. 16).

In step S219, the processor 81 performs a user interface operationprocess, and the processing proceeds to the next step. For example, withreference to the operation data Da, when a touch operation is performedon the touch panel 13, the processor 81 sets a user operationinstruction corresponding to the touch operation in accordance with theuser interface image displayed on the display 12 overlapping theposition where the touch operation is performed. Then, the processor 81performs a process corresponding to the set user operation instruction.

Next, the processor 81 determines whether or not the game is to be ended(step S220). Examples of a condition for ending the game in the abovestep S220 include the fact that the result of the game is finalized, thefact that a user performs the operation of ending the game, and thelike. When the game is not to be ended, the processing returns to theabove step S201, and the process of step S201 is repeated. When the maingame is to be ended, the processing of the flow chart ends. Hereinafter,the series of processes of steps S201 to S220 is repeatedly executeduntil it is determined in step S220 that the game is to be ended.

As described above, in the exemplary embodiment, when the normal displaymode (the non-stereoscopic display mode) and the stereoscopic displaymode are switched, a user interface image is displayed at positionsdifferent corresponding to the set display mode. Thus, it is possible toimprove convenience regarding the presentation of a user interfaceimage. Further, based on the state of the attachment of the main bodyapparatus 2 to the goggle apparatus 150, the display mode isautomatically switched. Thus, it is possible to seamlessly switch thedisplay mode. Further, in the exemplary embodiment, in the stereoscopicdisplay mode, a user interface image is displayed in the third areadifferent from the first area and the second area of the display 12where the right-eye image and the left-eye image are displayed. Thus, itis possible to display a user interface image that does not hinder thedisplay of a stereoscopic image.

It should be noted that in the above exemplary embodiment, the imagedisplay system is formed by attaching the main body apparatus 2 havingan information processing function to the goggle apparatus 150.Alternatively, the image display system may be formed in another form.As a first example, an image display system that displays a stereoscopicimage may be formed by providing in the goggle apparatus 150 a controlsection that generates an image by performing the above informationprocessing (game processing), and attaching to the goggle apparatus 150a display device having the function of displaying the image. In thiscase, the control section provided in the goggle apparatus 150 outputsimage data for displaying a stereoscopic image and a user interfaceimage on the display device to the display device, whereby thestereoscopic image and the user interface image are displayed on thedisplay device. It should be noted that in the form of the firstexample, it does not matter which of the display device and the goggleapparatus 150 a mechanism for detecting the attachment situation of thedisplay device, a mechanism for detecting the orientation of the imagedisplay system, a mechanism for receiving a user operation, and the likeare provided in. As a second example, separately from the goggleapparatus 150 to which a display device is attached, a control apparatusconnected in a wireless or wired manner to the display device may beprovided, and an image display system may be formed of the displaydevice, the goggle apparatus 150, and the control apparatus. In thiscase, operation data, acceleration data, angular velocity data,illuminance data, and the like are output from the display device to thecontrol apparatus, and a content image and a user interface image in adisplay mode based on the illuminance data are output from the controlapparatus to the display device. It should be noted that also in theform of the second example, it does not matter which of the displaydevice and the goggle apparatus 150 a mechanism for detecting theattachment situation of the display device, a mechanism for detectingthe orientation of the image display system, a mechanism for receiving auser operation, and the like are provided in. Then, in accordance withthe operation data, the acceleration data, and the angular velocity dataacquired from the display device and/or the goggle apparatus 150, thecontrol apparatus controls the display range of the content image to bedisplayed and outputs the content image to the display device. It shouldbe noted that in the exemplary embodiment, the main body apparatus 2 isused as an example of a display device.

It should be noted that in the above exemplary embodiment, the methodfor detecting the orientation of the main body apparatus 2 is merely anexample. Alternatively, the orientation of the main body apparatus 2 maybe detected using another method or another piece of data. As anexample, the main body apparatus 2 and/or the goggle apparatus 150 towhich the main body apparatus 2 is attached may be captured fromoutside, and the orientations of the main body apparatus 2 and/or thegoggle apparatus 150 may be detected using the captured image. Further,a controller for controlling the action of an operation object may benot only the left controller 3 or the right controller 4, but alsoanother controller.

Further, the game system 1 and/or the main body apparatus 2 may be anyapparatus, and may be a mobile game apparatus, any mobile electronicdevice (a PDA (Personal Digital Assistant), a mobile phone, a smartdevice (a smartphone or the like), a personal computer, a camera, atablet, or the like. If these pieces of hardware can execute a gameapplication, any of these pieces of hardware can function as a gameapparatus.

Further, in the above exemplary embodiment, an example has been usedwhere a left-eye image and a right-eye image having parallax with eachother are displayed on the left side and the right side of the screen ofthe display 12, whereby a stereoscopic image is displayed.Alternatively, the left-eye image and the right-eye image may bedisplayed on different screens from each other. For example, when thedisplay 12 provided in the main body apparatus 2 is formed of aplurality of display screens, a left-eye image is displayed on one ofthe plurality of display screens, and a right-eye image is displayed onthe other one of the plurality of display screens. In this case, theuser views the left-eye image displayed on the one of the plurality ofdisplay screens through the left-eye lens 153L with their left eye andalso views the right-eye image displayed on the other one of theplurality of display screens through the right-eye lens 153R with theirright eye and thereby can view a stereoscopic image through the goggleapparatus 150.

Further, a stereoscopic image and a non-stereoscopic image to bedisplayed on the main body apparatus 2 are displayed as a game image bythe processor 81 executing information processing (game processing) inaccordance with a user operation, or displayed as a moving image or astill image by the processor 81 reproducing the moving image orreproducing the still image in accordance with a user operation. Thatis, a stereoscopic image and a non-stereoscopic image to be displayed onthe main body apparatus 2 are generated by the processor 81 of the mainbody apparatus 2 performing information processing (e.g., gameprocessing, a moving image reproduction process, or a still imagereproduction process). Alternatively, at least a part of the process ofgenerating the stereoscopic image and the non-stereoscopic image may beperformed by another apparatus. For example, if the main body apparatus2 is further configured to communicate with another apparatus (e.g., aserver, another image display device, another game apparatus, anothermobile terminal, or another information processing apparatus), the otherapparatus may operate in conjunction with to perform the steps. Anotherapparatus may thus perform at least some of the steps, thereby enablingprocessing similar to that described above. Further, the aboveinformation processing can be performed by a processor or thecooperation of a plurality of processors, the processor or the pluralityof processors included in an information processing system including atleast one information processing apparatus. Further, in the aboveexemplary embodiment, information processing can be performed by theprocessor 81 of the main body apparatus 2 executing a predeterminedprogram. Alternatively, part or all of the processing of the flow chartsmay be performed by a dedicated circuit included in the main bodyapparatus 2.

Here, according to the above variations, it is possible to achieve theexemplary embodiment also by a system form such as cloud computing, or asystem form such as a distributed wide area network or a local areanetwork. For example, in a system form such as a distributed local areanetwork, it is possible to execute the processing between a stationaryinformation processing apparatus (a stationary game apparatus) and amobile information processing apparatus (a mobile game apparatus) by thecooperation of the apparatuses. It should be noted that, in these systemforms, there is no particular limitation on which apparatus performs theabove processing. Thus, it goes without saying that it is possible toachieve the exemplary embodiment by sharing the processing in anymanner.

Further, the processing orders, the setting values, the conditions usedin the determinations, and the like that are used in the informationabove processing are merely illustrative. Thus, it goes without sayingthat the exemplary embodiment can be achieved also with other orders,other values, and other conditions.

Further, the above program may be supplied to the game system 1 not onlythrough an external storage medium such as an external memory, but alsothrough a wired or wireless communication link. Further, the program maybe stored in advance in a non-volatile storage device included in theapparatus. It should be noted that examples of an information storagemedium having stored therein the program may include CD-ROMs, DVDs,optical disk storage media similar to these, flexible disks, hard disks,magneto-optical disks, and magnetic tapes, as well as non-volatilememories. Alternatively, an information storage medium having storedtherein the program may be a volatile memory for storing the program. Itcan be said that such a storage medium is a storage medium readable by acomputer or the like. For example, it is possible to provide the variousfunctions described above by causing a computer or the like to load aprogram from the storage medium and execute it.

While some exemplary systems, exemplary methods, exemplary devices, andexemplary apparatuses have been described in detail above, the abovedescriptions are merely illustrative in all respects, and do not limitthe scope of the systems, the methods, the devices, and the apparatuses.It goes without saying that the systems, the methods, the devices, andthe apparatuses can be improved and modified in various manners withoutdeparting the spirit and scope of the appended claims. It is understoodthat the scope of the systems, the methods, the devices, and theapparatuses should be interpreted only by the scope of the appendedclaims. Further, it is understood that the specific descriptions of theexemplary embodiment enable a person skilled in the art to carry out anequivalent scope on the basis of the descriptions of the exemplaryembodiment and general technical knowledge. When used in thespecification, the components and the like described in the singularwith the word “a” or “an” preceding them do not exclude the plurals ofthe components. Furthermore, it should be understood that, unlessotherwise stated, the terms used in the specification are used in theircommon meanings in the field. Thus, unless otherwise defined, all thejargons and the technical terms used in the specification have the samemeanings as those generally understood by a person skilled in the art inthe field of the exemplary embodiment. If there is a conflict, thespecification (including definitions) takes precedence.

As described above, the exemplary embodiment can be used as an imagedisplay system, an image display program, an image display method, adisplay device, and the like that are capable of improving convenienceregarding the presentation of a user interface image.

What is claimed is:
 1. An image display system including a displaydevice having a display screen configured to display an image, and agoggle apparatus to which the display device is attachable, the imagedisplay system comprising a computer configured to: set the displaydevice to a first display mode or a second display mode different fromthe first display mode; in the first display mode, display on thedisplay screen a first image including a content image that is anon-stereoscopic image, and a first user interface image; and in thesecond display mode, display on the display screen a second imageincluding a content image composed of a left-eye image and a right-eyeimage having parallax with each other, and a second user interface imagecorresponding to the first user interface image, wherein in the seconddisplay mode, the second user interface image is displayed at a positiondifferent from a position on the display screen where the first userinterface image is displayed in the first display mode.
 2. The imagedisplay system according to claim 1, wherein the computer is furtherconfigured to detect whether or not the display device is in an attachedstate where the display device is attached to the goggle apparatus, ordetect whether or not the display device is in a halfway attached statewhere the display device is being attached to the goggle apparatus, andwhen the display device is set to the first display mode, the displaydevice is switched to the second display mode based on the detectionresult.
 3. The image display system according to claim 2, wherein thedisplay device includes an illuminance sensor, the goggle apparatusincludes a light-shielding member configured to, when the display deviceis in the attached state where the display device is attached to thegoggle apparatus, or is in the halfway attached state where the displaydevice is being attached to the goggle apparatus, block light from thedisplay device to the illuminance sensor, and based on a detectionresult of the illuminance sensor, it is detected whether or not thedisplay device is in the attached state where the display device isattached to the goggle apparatus, or it is detected whether or not thedisplay device is in the halfway attached state where the display deviceis being attached to the goggle apparatus.
 4. The image display systemaccording to claim 1, wherein the display device includes a touch panelon the display screen, the first user interface image displayed on thedisplay screen enables an operation instruction corresponding to a touchoperation on the touch panel, and the second user interface imagedisplayed on the display screen enables an operation instructioncorresponding to a touch operation on the touch panel in a state wherethe display device is attached to the goggle apparatus.
 5. The imagedisplay system according to claim 1, wherein as the content imagecomposed of the left-eye image and the right-eye image, an imagecorresponding to the content image displayed as the non-stereoscopicimage is displayed on the display screen.
 6. The image display systemaccording to claim 1, wherein in the second display mode, the contentimage displayed in the first display mode immediately before being setin the second display mode is displayed as a stereoscopic image composedof a left-eye image and a right-eye image on the display screen.
 7. Theimage display system according to claim 1, wherein in the second displaymode, the left-eye image is displayed in a first area of the displayscreen, the right-eye image is displayed in a second area of the displayscreen that is different from the first area, and the second userinterface image is displayed in a third area of the display screen thatis different from the first area and the second area.
 8. The imagedisplay system according to claim 1, wherein a user interface image thathas substantially the same function as and has a different shape fromthe first user interface image is displayed as the second user interfaceimage.
 9. The image display system according to claim 8, wherein in thesecond display mode, by adjusting a shape of the second user interfaceimage to match a shape of a third area of the display screen that isdifferent from the first area of the display screen for displaying theleft-eye image and the second area of the display screen for displayingthe right-eye image, the second user interface image is displayed in thethird area.
 10. The image display system according to claim 7, whereinthe third area is set in an upper portion or a lower portion of thedisplay screen that is sandwiched between the first area and the secondarea of the display screen.
 11. The image display system according toclaim 10, wherein the third area is set in a lower portion of thedisplay screen that is sandwiched between the first area and the secondarea of the display screen.
 12. The image display system according toclaim 7, wherein the goggle apparatus includes an opening portionconfigured to, when the display device is attached to the goggleapparatus, expose the third area that is a part of the display screen atleast to outside.
 13. The image display system according to claim 12,wherein the opening portion is formed at a position corresponding to anose of a user when the user wears the goggle apparatus.
 14. The imagedisplay system according to claim 1, wherein in the first display mode,the first user interface image is displayed in a superimposed manner ona content image displayed on the display screen.
 15. The image displaysystem according to claim 1, wherein in the second display mode, thesecond user interface image is displayed as a non-stereoscopic image onthe display screen.
 16. The image display system according to claim 2,wherein the display device further includes a display device sideconnection end configured to electrically connect to another apparatus,the goggle apparatus includes a goggle apparatus side connection endconfigured to electrically connect to the display device side connectionend, and in accordance with a connection between the display device sideconnection end and the goggle apparatus side connection end, it isdetected whether or not the display device is in an attached state wherethe display device is attached to the goggle apparatus, or it isdetected whether or not the display device is in a halfway attachedstate where the display device is being attached to the goggleapparatus.
 17. A non-transitory computer-readable storage medium havingstored therein an image display program executed by a computer includedin a display device having a display screen configured to display animage, the image display program causing the computer to execute:setting the display device to a first display mode or a second displaymode different from the first display mode; in the first display mode,displaying on the display screen a first image including a content imagethat is a non-stereoscopic image, and a first user interface image; andin the second display mode, displaying on the display screen a secondimage including a content image composed of a left-eye image and aright-eye image having parallax with each other, and a second userinterface image corresponding to the first user interface image, whereinin the second display mode, the second user interface image is displayedat a position different from a position on the display screen where thefirst user interface image is displayed in the first display mode. 18.An image display method for displaying an image on a display devicehaving a display screen configured to display an image, the imagedisplay method comprising: setting the display device to a first displaymode or a second display mode different from the first display mode; inthe first display mode, displaying on the display screen a first imageincluding a content image that is a non-stereoscopic image, and a firstuser interface image; and in the second display mode, displaying on thedisplay screen a second image including a content image composed of aleft-eye image and a right-eye image having parallax with each other,and a second user interface image corresponding to the first userinterface image, wherein in the second display mode, the second userinterface image is displayed at a position different from a position onthe display screen where the first user interface image is displayed inthe first display mode.
 19. A display device having a display screenconfigured to display an image, the display device comprising a computerconfigured to: set the display device to a first display mode or asecond display mode different from the first display mode; in the firstdisplay mode, display on the display screen a first image including acontent image that is a non-stereoscopic image, and a first userinterface image; and in the second display mode, display on the displayscreen a second image including a content image composed of a left-eyeimage and a right-eye image having parallax with each other, and asecond user interface image corresponding to the first user interfaceimage, wherein in the second display mode, the second user interfaceimage is displayed at a position different from a position on thedisplay screen where the first user interface image is displayed in thefirst display mode.